Azure is fundamentally a public cloud computing platform. Its offerings span Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS), which support workloads like analytics, virtual computing, storage, networking, and many others.
Installing Azure
1. Set up an Event Hub
Using the official Azure documentation Quickstart: Create an event hub using Azure portal
2. Set up a new Shared access policy that grants access to the Event Hub you created, and ensure you choose the Listen permission.
3. Retrieve the Event Hub Shared Access policies Connection string–primary key from the Shared access policy you created earlier. You will use it to configure your tenant.
Sample Connection string–primary key:
4. Retrieve the Consumer Group Name
Path: All services, then Event Hubs, then Your_Event_Hub_Namespace, then Event Hubs, then Your_Event_Hub_Instance, then Consumer groups. This will be used to configure your tenant.
Set up a dedicated consumer group for Logstash. Avoid the $default consumer group and any other group that may already be in use. Sharing consumer groups across unrelated consumers may lead to unexpected behavior and potentially missed events. Every Logstash instance should use the same consumer group so they can collaborate on processing events.
5. Set up a Storage Account
Using the official Azure documentation Quickstart: Create a storage account
6. Retrieve the Storage Container Name
Path: All services, then Storage accounts, then Your_Storage_Account, then Containers. This will be used to configure your tenant.
7. Obtain the Storage Account Connection string with key to access the Azure Storage Account.
Locate the connection string at: All services, then Storage accounts, then Your_Storage_Account, then Access keys. This will be used to configure your tenant.
Sample connection string:
8.Configure your Azure Subscription to send log to the Event Hub
Open Subscription and select Resource providers. Look for Event Grid, and confirm it is registered under Resource providers.
9. Create a new Event by going to Events, then Event Subscription.
10. Configure the Event Subscription so it sends logs to the Event Hub you created earlier.
11. Complete the form as shown below using the information gathered in the earlier steps. To add multiple Event Hub configurations, click the Add tenant button.
The input field Event Hub Shared access policies - Connection string refers to Azure's Event Hub Shared Access Policies - Connection string-primary key: Value obtained in step 3
Consumer Group Name: Value obtained in step 4
Storage Container Name: Value obtained in step 6
Storage Account Connection string with key: Value obtained in step 7