How to do Real-Time Analytics Using Apache Kafka and Azure Data Explorer by Niels Berglund

Session Title: How to do Real-Time Analytics Using Apache Kafka and Azure Data Explorer
Speaker: Niels Berglund

Abstract: The de facto standard for real-time event streaming is Apache Kafka, and a lot of businesses are streaming tons of data; business events, IoT/telemetry events, etc. The problem is how we can perform analytics and get business insight into the data we are streaming over Kafka.

The answer to this is Azure Data Explorer (ADX). Azure Data Explorer is a fast, fully managed data analytics service for real-time analysis on large volumes of data streaming from applications, websites, IoT devices, and more. It is a big-data analytics database that allows ingestion of event streams from, among others, Apache Kafka.

In this “demo-heavy” session, we see how we stream event data from Apache Kafka (running on Confluent Cloud in Azure) into Azure Data Explorer.

Some of the topics we cover:

* Overview of Apache Kafka and Confluent Cloud.
* Introduction to Azure Data Explorer.
* Ingestion of data from Kafka into ADX.
* Analyze ingested data in ADX.