DoubleCloud Managed Service for Apache Kafka®

A fully managed open-source Apache Kafka® service for distributed delivery, storage, and real-time data processing.

What we offer

A managed platform for configuring clusters, updating their values so that you can focus on your project rather than routine tasks

Features and benefits

Open source

The DoubleCloud Managed Service for Apache Kafka was built based on the original Apache Kafka distributive.

Easy to use

The DoubleCloud Managed Service for Apache Kafka manages Zookeeper brokers and clusters, and configures clusters and versioning on AWS, freeing you up to develop data stream processing applications rather than managing your data infrastructure.

Bring your own account

Deploy Managed Apache Kafka in your AWS account. All computations and data will be in your AWS account, and DoubleCloud will handle the management part. Stay in control of your data but don’t overwhelm yourself by managing clusters and infrastructure.

Highly secure

Connections are encrypted via TLS protocol, with SASL-authenticated access control lists (ACL) to topics.

Fault tolerant

Distribute cluster brokers across different availability zones, and set up a replication factor to ensure high availability.

Analytics in real time

Deliver large amounts of data directly to ClickHouse with no additional development.

Start your trial today

Frequently asked questions

What is Apache Kafka?

Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system, developed by the Apache Software Foundation and written in Java and Scala.

Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system, developed by the Apache Software Foundation and written in Java and Scala.

What is ZooKeeper for?

ZooKeeper is mainly used to track the status of nodes in the Kafka cluster and maintain a list of Kafka topics and messages. In DoubleCloud, we take care of it as part of the managed service.

ZooKeeper is mainly used to track the status of nodes in the Kafka cluster and maintain a list of Kafka topics and messages. In DoubleCloud, we take care of it as part of the managed service.

What costs does using Kafka with DoubleCloud involve?

You only pay for compute and storage, without any additional costs for backups, traffic, or ZooKeeper.

You only pay for compute and storage, without any additional costs for backups, traffic, or ZooKeeper.

Can I change a cluster configuration after creating it? Will there be any downtime?

Yes, you can change a cluster configuration after it is created with no downtime.

Yes, you can change a cluster configuration after it is created with no downtime.

What is BYOA (Bring Your Own Account)?

BYOA is a handy piece of functionality with DoubleCloud that gives you the ability to deploy managed ClickHouse and managed Apache Kafka in your AWS account.

That means all data, computations, backups, encryption keys and S3 buckets are deployed in the user’s AWS account and the user is responsible to cover these costs to AWS.

You’ll still have the same level of functionality on the DoubleCloud management console, including all existing features like monitoring, backups, patching, configuration, security and high availability handled by us.

BYOA is a handy piece of functionality with DoubleCloud that gives you the ability to deploy managed ClickHouse and managed Apache Kafka in your AWS account.

That means all data, computations, backups, encryption keys and S3 buckets are deployed in the user’s AWS account and the user is responsible to cover these costs to AWS.

You’ll still have the same level of functionality on the DoubleCloud management console, including all existing features like monitoring, backups, patching, configuration, security and high availability handled by us.

How does pricing differ in BYOA mode from the regular managed services on DoubleCloud?

All resources like virtual machines, disks, S3 and traffic that’s provisioned and consumed is covered by users in AWS. DoubleCloud is providing automation of management Clickhouse and Apache Kafka as a service. That includes monitoring, backups, patching, configuration, security, high availability and load balancing, etc.

For the management part, DoubleCloud takes a management fee. To understand the price for BYOA, you’ll need to use a calculator at app.double.cloud and select the external network during the cluster’s configuration.

For more details of how to setup external network and activate BYOA see here.

All resources like virtual machines, disks, S3 and traffic that’s provisioned and consumed is covered by users in AWS. DoubleCloud is providing automation of management Clickhouse and Apache Kafka as a service. That includes monitoring, backups, patching, configuration, security, high availability and load balancing, etc.

For the management part, DoubleCloud takes a management fee. To understand the price for BYOA, you’ll need to use a calculator at app.double.cloud and select the external network during the cluster’s configuration.

For more details of how to setup external network and activate BYOA see here.

What resources will be provisioned in my account in BYOA mode?

We have two groups of resources that would be created in your account. In the first stage, we provision a new VPC, IAM role and VPC IPv6 CIDR Block.

These resources are created by adding external networks (BYOA) and launching a CloudFormation stack in your AWS account.

After that, DoubleCloud will be able to create resources only in that VPC under the role that was provided at the beginning.

In the second stage, virtual machines, disks, KMS keys and S3 buckets will be created when the user provisions a new cluster.

We have two groups of resources that would be created in your account. In the first stage, we provision a new VPC, IAM role and VPC IPv6 CIDR Block.

These resources are created by adding external networks (BYOA) and launching a CloudFormation stack in your AWS account.

After that, DoubleCloud will be able to create resources only in that VPC under the role that was provided at the beginning.

In the second stage, virtual machines, disks, KMS keys and S3 buckets will be created when the user provisions a new cluster.

  1. Apache® and Apache Kafka® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.