Getting 'An existing connection was forcibly closed by the remote host.' from Azure

While trying to follow the 'Get Started with Events Hub' example for Microsoft Azure...

sending EventData to Azure Eventhub larger than 256k

I need to send some data to eventhub, but it is not going through because the size is too big. Is there a way to compress the data or some command that chunks up the data and joins it in event...

In Azure Eventhub reciever giving "Encountered error while fetching the list of EventHub PartitionIds" error

I am trying to implement the receiver part as per the tutorial https://azure.microsoft.com/en-us/documentation/articles/event-hubs-java-ephjava-getstarted/ Failure while registering:...

Looking for an azure service to manage web push notifications

I'm implementing a notifications feature in an html5 web app I'm working on. The feature requirements is to receive push notifications (strings) from the server and display them immediately on the...

What is causing Azure Event Hubs ReceiverDisconnectedException/LeaseLostException?

I'm receiving events from an EventHub using EventProcessorHost and an IEventProcessor class (call it: MyEventProcessor). I scale this out to two servers by running my EPH on both servers, and...

Azure Event Hub Synchronous Mechanism

I am new to Azure Event hub. As per the examples there is a "Send" method in the Azure Event Hub client which sends the event synchronously, but is there something synchronous in the Receiver...

How to trigger to multiple eventhubs in azure webjob or function

I have a multiple Azure Event Hubs located in different Azure Regions. I want to write a webjob/function that can receive messages from all of these Event Hubs without me having to hard code which...

Using finalizer to close EventHubClient

I have a class that uses the EventHubClient (Microsoft.Azure.EventHubs) to connect to an Azure EventHub. I use a method on the class that sends events to the EventHub and after I'm done, I want to...

How can I clear the values in System.Azure.EventHubs.EventDataBatch in c#?

I am using System.Azure.EventHubs.EventDataBatch to send a batch of events to the Azure Event Hub. Once a batch is sent successfully, I would like to clear the event collection and then add new...

Azure Event Hub connectivity issues with Spring Cloud Stream Kafka

We use Azure Event Hubs with the Kafka integration option. Our services are on Java, Spring Boot, Spring Cloud Stream. They are deployed on Azure AKS. We have enabled service endpoints on the...

Failing to decompress streaming data by using UDF on Azure Databricks - Python

I am trying to read Azure EventHub GZIP compressed messages using Azure DataBricks and python (PySpark), but using UDF isn't working with BinaryType data. Well, here is the part where I check what...

How to setup Serilog with AzureEventHub

I want to use Serilog with the sink AzureEventHub, but I can't find any documentation on how to set it up. I am running an ASP.NET MVC Core project. Anyone got an idea or can give a clue to the solution?

MaxBatchSize in Host.json for Azure Function not working

I have below confiugration for my Azure Function in host.json & I am sending 30000 msgs in multiple batches to EvenHub but I see that my azure function doesn't pick more than 64 which is a default...

Is it possible to consume from an Azure EventHub topic using Apache Beam / Google Cloud Dataflow?

Problem We'd like to consume from an EventHub topic in Azure using a dataflow pipeline in Google Cloud. Question Is it known whether KafkaIO allows for consuming from EventHubs directly in an...

Azure Functions with IoT Hub not able to retrieve partitions

I am getting this error when I am trying to connect to IoT Hub using Azure functions: The listener for function 'IoTHubDataFunction' was unable to start. Microsoft.Azure.EventHubs.Processor:...

Not able connect to EventHub via KAFKA api

am getting below exception while connecting Event Hub via kafka libraries. Caused by: org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'sasl_auth_bytes': Bytes size -1...

Event Hubs data to a SQL Data Warehouse (Synapse)

we are trying to integrate Event Hub (EH) data (~ 200MB and 50k messages per minute) to a SQL Data Warehouse (DW) staging area. So far we have tried to solve this by directly reading the EH data...

IoT Hub message routing with DeviceLifecycleEvents source does not work

I am already using an IoT Hub and have configured message routing to route TwinChangeEvents to an Event Hub. An Azure function with an EventHubTrigger processes the messages. This works perfectly...

Azure EventHub socketexception 10054 when creating CreateBatchAsync and connected in VPN

I am getting below error when executing below code snippet and its causing issue when i connected in VPN And this piece of code is working fine when i don't connect to VPN, could anyone help me...

Increase Throughput of Debezium Kafka Connector

I have started to use Debezium recently to deal with capture changes data in realtime and sink to the target database. Instead of Kafka, I use Azure Event Hub with Kafka Connect to connect SQL...

Azure Kubernetes Container Logs to Event Hub

How to logs (stdout / stderr) from all container pods azure Kubernetes to the event hub. I can able to see all logs by Log Analytics workspaces >> Logs using an Azure query language. I want to...

Kafka event Producer on RDBMS data & reading it at consumer in same order of producer in case of multiple topics

I have two business entities in RDBMS: Associate & AssociateServingStore. I planned to have two topics currently writing ADD/UPDATE/DELETE into AssociateTopic & AssociateServingStoreTopic, and...

GCP Dataflow Kafka (as Azure Event Hub) -> Big Query

TDLR; I have a Kafka-enabled Azure Event Hub that I'm trying to connect to from Google Cloud's Dataflow service to stream the data into Google Big Query. I successfully can use the Kafka CLI to...

Java send to EventHub (not shutting down gracefully)

I am trying to send alot of data from a server over to my event hub, however when I try to use the example code from microsoft doc the data is being sent but the application never stop running. I...

Azure Event Hub - Partitions usecase question

I'm new to Azure Event Hubs and I'm having a hard time understanding the Partitions. I have the following scenario: 1 Event Hub Namespace 1 actual Event Hub 2 Partitions in the Event Hub 2...

SocketExceptions receiving end EventHub

Our solution consists of a series of Azure functions that have EventHub triggers that subscribe to EventHubs. De functions form a chain and messages get passed from function to function via...

Azure Kafka Bootstrap broker disconnected

I try to create an Apache Kafka connection to Azure event hubs with reactor kafka in a spring boot application. At first I followed the official Azure tutorial to set up Azure event hubs and the...

Azure EventHubs throws Exception: At least one receiver for the endpoint is created with epoch of '0', and so non-epoch receiver is not allowed

Introduction Hello all, we're currently working on a microservice platform that uses Azure EventHubs and events to sent data in between the services. Let's just name these services:...

Azure Event Hubs - Checkpoint per event?

Given that I have 3 consumers for a single hub, all consuming the same consumer group, lets say that client A got event 1, client B got event 2 and client C got event 3. In a twist of fate, client...

Generate SAS token to manage Azure Blob Container using PowerShell REST API

I'm downloading files from Azure Blob Storage with PowerShell REST API. The code works perfectly, the only think is that I have to hardcode the SAS. Instead of hardcoding the SAS I want to...