Azure Event Hubs

Expert knowledge for Azure Event Hubs development including troubleshooting, best practices, deci…

by microsoftdocs · MIT

The skill

Expert knowledge for Azure Event Hubs development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when using Kafka-compatible clients, Flink/Spark, geo-replication, Avro capture, or the Event Hubs emulator, and other Azure Event Hubs related development tasks. Not for Azure Service Bus (use azure-service-bus), Azure Notification Hubs (use azure-notification-hubs), Azure Event Grid (use azure-event-grid), Azure Web PubSub (use azure-web-pubsub).

Azure Event Hubs Skill

This skill provides expert guidance for Azure Event Hubs. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L37-L49	Diagnosing and fixing Event Hubs errors: Kafka/AMQP issues, .NET and ARM exceptions, auth failures, Blob checkpoint problems, and connectivity troubleshooting.
Best Practices	L50-L56	Best practices for integrating Event Hubs via AMQP/Kafka/HTTPS, building stateless replication with Functions, and scaling with partitions and throughput units.
Decision Making	L57-L63	Guidance on choosing Event Hubs tiers, auto-inflate settings, geo-replication modes, and planning migrations from Apache Kafka to Event Hubs.
Architecture & Design Patterns	L64-L69	Patterns and guidance for Event Hubs reliability: availability/consistency design, geo-disaster recovery, and building/operating replication tasks (often with Azure Functions).
Limits & Quotas	L70-L79	Event Hubs limits, quotas, and tier differences; max message sizes, capture intervals, platform behaviors, and governance via application groups.
Security	L80-L108	Securing Event Hubs: auth (Entra ID, SAS, RBAC, managed identities), encryption/CMK, confidential computing, TLS, and network access (NSP, VNet, firewall, Private Link, Azure Policy compliance).
Configuration	L109-L120	Configuring Event Hubs behavior: partitions, retention, cleanup, geo-DR, replication, log compaction, Avro capture, monitoring, app groups, and using the local emulator.
Integrations & Coding Patterns	L121-L137	Patterns and code for integrating Event Hubs with .NET, Kafka (clients, Streams, Connect, Debezium), Flink, Spark, Akka, schema/JSON registry, and adding metadata or managing hubs programmatically
Deployment	L138-L143	Guides for deploying Event Hubs with Kafka mirroring (MirrorMaker 1/2), setting up geo-replication, and running/local-testing Event Hubs apps using the emulator.

Troubleshooting

Topic	URL
Resolve common Azure Event Hubs Kafka migration issues	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-frequently-asked-questions
Troubleshoot Azure Event Hubs for Apache Kafka	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-troubleshooting-guide
Troubleshoot AMQP errors in Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-amqp-troubleshoot
Resolve Azure Event Hubs .NET messaging exceptions	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-messaging-exceptions
Handle Azure Event Hubs .NET exceptions and recommended actions	https://learn.microsoft.com/en-us/azure/event-hubs/exceptions-dotnet
Resolve Azure Resource Manager exceptions for Event Hubs operations	https://learn.microsoft.com/en-us/azure/event-hubs/resource-manager-exceptions
Troubleshoot authentication and authorization failures in Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-authentication-authorization
Resolve Blob Storage checkpoint store issues for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-checkpoint-store-issues
Diagnose and fix Azure Event Hubs connectivity issues	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshooting-guide

Best Practices

Topic	URL
Exchange Event Hubs events across AMQP, Kafka, and HTTPS	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-exchange-events-different-protocols
Design stateless event replication with Azure Functions	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-replicator-functions
Scale Azure Event Hubs with partitions and throughput units	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-scalability

Decision Making

Topic	URL
Plan migration from Apache Kafka to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-migration-guide
Decide when and how to use Event Hubs Auto Inflate	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-auto-inflate
Choose and manage Azure Event Hubs geo-replication modes	https://learn.microsoft.com/en-us/azure/event-hubs/geo-replication

Architecture & Design Patterns

Topic	URL
Design for availability and consistency in Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-availability-and-consistency
Apply Event Hubs event replication task patterns	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-patterns

Limits & Quotas

Topic	URL
Compare Event Hubs tier features and quotas	https://learn.microsoft.com/en-us/azure/event-hubs/compare-tiers
Configure Event Hubs Capture intervals and limits	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-overview
Azure Event Hubs platform limits and behavioral details	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-faq
Send and receive large Event Hubs messages	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quickstart-stream-large-messages
Review Azure Event Hubs quotas and limits	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quotas
Govern Event Hubs resources with application groups	https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-overview

Security

Topic	URL
Associate network security perimeters with Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/associate-network-security-perimeter
Authenticate applications with Entra ID for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-application
Use managed identities to authenticate to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity
Authenticate to Event Hubs from VMs with managed identity	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity-virtual-machine
Implement SAS authentication for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-shared-access-signature
Authorize Event Hubs access using Entra ID and RBAC	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-azure-active-directory
Choose and configure Event Hubs authorization options	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-event-hubs
Configure SAS authorization for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-shared-access-signature
Enable confidential computing for Azure Event Hubs Dedicated	https://learn.microsoft.com/en-us/azure/event-hubs/confidential-computing
Configure customer-managed keys for Event Hubs encryption	https://learn.microsoft.com/en-us/azure/event-hubs/configure-customer-managed-key
Enable and configure managed identities for Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/enable-managed-identity
Configure managed identity for Event Hubs Capture	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-managed-identity
Retrieve and understand Event Hubs connection strings	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-get-connection-string
Configure IP firewall rules for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-ip-filtering
Secure Event Hubs with virtual network service endpoints	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-service-endpoints
Configure network security for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/network-security
Secure Event Hubs with Network Security Perimeter	https://learn.microsoft.com/en-us/azure/event-hubs/network-security-perimeter
Migrate Event Hubs apps to passwordless authentication with Entra ID	https://learn.microsoft.com/en-us/azure/event-hubs/passwordless-migration-event-hubs
Use built-in Azure Policy definitions for Event Hubs governance	https://learn.microsoft.com/en-us/azure/event-hubs/policy-reference
Restrict Event Hubs access using Private Link endpoints	https://learn.microsoft.com/en-us/azure/event-hubs/private-link-service
Apply regulatory compliance policies to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/security-controls-policy
Audit Event Hubs TLS compliance using Azure Policy	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-audit-minimum-version
Configure Event Hubs client applications to use specific TLS versions	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-client-version
Set minimum TLS version for Azure Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-minimum-version
Enforce minimum TLS version for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-enforce-minimum-version

Configuration

Topic	URL
Configure partitioning, retention, and cleanup for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/configure-event-hub-properties
Configure geo-disaster recovery pairing for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/configure-geo-disaster-recovery
Configure code-free Event Hubs replication tasks	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-configuration
Understand and use Event Hubs captured Avro schema	https://learn.microsoft.com/en-us/azure/event-hubs/explore-captured-avro-files
Reference monitoring metrics and logs for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/monitor-event-hubs-reference
Configure Event Hubs application groups for resource governance	https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-with-app-groups
Configure and run the Azure Event Hubs emulator locally	https://learn.microsoft.com/en-us/azure/event-hubs/test-locally-with-event-hub-emulator
Configure and use log compaction in Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/use-log-compaction

Integrations & Coding Patterns

Topic	URL
Add custom metadata to Event Hubs events	https://learn.microsoft.com/en-us/azure/event-hubs/add-custom-data-event
Configure Apache Kafka clients for Azure Event Hubs compatibility	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations
Use Kafka Streams with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-streams
Use Kafka transactions with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-transactions
Connect .NET applications to Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/connect-event-hub
Connect Akka Streams to Azure Event Hubs via Kafka	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-akka-streams-tutorial
Use Debezium CDC with Kafka Connect on Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-debezium
Integrate Kafka Connect with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-tutorial
Connect Apache Flink to Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-flink-tutorial
Connect Apache Spark streaming apps to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial
Use .NET management libraries to provision Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-management-libraries
Implement client-side schema enforcement for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-client-side-enforcement
Use JSON Schema registry with Kafka clients on Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-json-schema-kafka

Deployment

Topic	URL
Mirror Kafka brokers to Event Hubs with MirrorMaker 1	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirror-maker-tutorial
Replicate Kafka clusters to Event Hubs with MirrorMaker 2	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirrormaker-2-tutorial
Configure and operate Event Hubs geo-replication	https://learn.microsoft.com/en-us/azure/event-hubs/use-geo-replication

Use this skill

Connect your agent to the Skill Store MCP server and ask for it by ref: microsoftdocs/azure-event-hubs-61409160258.

Download SKILL.md · Markdown version

Details

Publisher: microsoftdocs
Category: Data & Analytics › Data pipelines & ETL
License: MIT
Updated: 2026-10-19

References

Related skills

Azure Event Grid Expert knowledge for Azure Event Grid development including troubleshooting, best practices, deci…
Azure Notification Hubs Expert knowledge for Azure Notification Hubs development including troubleshooting, best practice…
Azure Service Bus Expert knowledge for Azure Service Bus development including troubleshooting, best practices, dec…
Azure Web Pubsub Expert knowledge for Azure Web PubSub development including troubleshooting, best practices, deci…
Azure Stream Analytics Expert knowledge for Azure Stream Analytics development including troubleshooting, best practices…