Unlocking the Power Duo:
Kafka and ClickHouse for real-time analytics

ClickHouse and Kafka, scalable and open-source, form a powerful duo for building cost-effective, real-time analytics systems, suitable for log analysis, clickstream analytics, financial transactions, and more. The integration method of this combination is an important consideration that affects ingestion performance, resource distribution, and costs.

In this workshop, we explore several key topics:In this workshop, we explore several key topics:

• The advantages and disadvantages of integrating ClickHouse with Kafka’s native engine versus using an external writer.
• Strategies for optimizing CPU and network resources across various stages, including reading, writing, transforming, and computing.
• A hands-on demo for implementing this integration using Terraform.
• Real world example from Plotline: an in-app engagement platform, which utilizes DoubleCloud’s managed ClickHouse and Kafka services for high-speed clickstream and event-driven analytics.

This workshop is designed to provide a comprehensive understanding of how to effectively combine ClickHouse and Kafka, ensuring participants leave with practical knowledge and real-world applications.