MirrorMaker Apache Kafka® connector
This connector type replicates Apache Kafka® topics between clusters.
-
Go to the Clusters
-
Select the Apache Kafka® cluster for which you want to create a connector.
-
Open the Connectors tab and click Create.The Connector configuration page will open.
-
Select MirrorMaker.
-
Select one or more topics from which to export the data.
-
Choose the Compression type:
-
Toggle the Source cluster and the Target cluster between which you want to transfer your Apache Kafka® messages.
-
Under Basic parameters:
-
Name your connector.
-
Under Max tasks, specify the maximum number of tasks the connector will run in parallel.
-
-
Under Source cluster, specify its Alias. Alias is an additional identifier for the cluster's topics. THis prevents mirroring loops and helps identify the topics in the logs.
For example, a topic
test
from the cluster with the aliassource-testing-cluster
will get a new name ofsource-testing-cluster.test
. -
Under Target cluster:
-
Specify the target cluster's Alias.
-
Provide the comma-separated list of servers used to bootstrap connections to Apache Kafka®.
-
Provide the SASL username.
-
Specify the SASL mechanism:
PLAIN
,SHA-256
,SHA-512
,OAUTHBEARER
, orGSSAPI
(default). -
Enter the name of the Security protocol.
-
Provide the SSL TrustStore certificates in the PEM format.
-
-
Click Submit.
Use the ConnectorService
create method and pass the following parameters:
cluster_id
To find thecluster_id
, get a list of clusters in the project.connector_spec
with connector parameters.