Kafka Connect 3

Setup Kafka Connect from Ambari

When installing Kafka, ensure to select the appropriate nodes for installing the Kafka broker and connect services.

Kafka Connect Setup with Kerberos, SSL, and Ranger

Since Kafka is already configured with SSL, Kerberos, and Ranger, the underlying topics maintain these settings during Kafka connect operations. Below are the configurations for the Advanced kafka3-connect-distributed section in Kafka3's CONFIGS.

bootstrap.servers=<broker1-host>:6669,<broker2-host>:6669,<brokern-host>:6669 config.storage.replication.factor=3 config.storage.topic=connect-configs group.id=connect-cluster key.converter=org.apache.kafka.connect.json.JsonConverter key.converter.schemas.enable=true offset.flush.interval.ms=10000 offset.storage.replication.factor=3 offset.storage.topic=connect-offsets plugin.path=/usr/odp/current/kafka3-broker/libs/* listeners=localhost:8083 rest.advertised.listener=HTTPS status.storage.replication.factor=3 status.storage.topic=connect-status sun.security.krb5.debug=true value.converter=org.apache.kafka.connect.json.JsonConverter value.converter.schemas.enable=true sasl.enabled.mechanisms=GSSAPI sasl.kerberos.service.name=kafka sasl.mechanism=GSSAPI sasl.mechanism.inter.broker.protocol=GSSAPI security.inter.broker.protocol=SASL_SSL security.protocol=SASL_SSL ssl.key.password=<password> ssl.keystore.location=/opt/security/pki/keystore.jks ssl.keystore.password=<password> ssl.truststore.location=/opt/security/pki/truststore.jks ssl.truststore.password=<password> java.security.auth.login.config=/usr/odp/current/kafka-broker/config/kafka_jaas.conf java.security.krb5.kdc=<KDC server hostname> java.security.krb5.realm=<KDC server realm name> javax.security.auth.useSubjectCredsOnly=true consumer.bootstrap.servers=<broker1-host>:6669,<broker2-host>:6669,<brokern-host>:6669 consumer.security.protocol=SASL_SSL consumer.ssl.truststore.location=/opt/security/pki/truststore.jks consumer.ssl.truststore.password=<password> producer.bootstrap.servers=<broker1-host>:6669,<broker2-host>:6669,<brokern-host>:6669 producer.security.protocol=SASL_SSL producer.ssl.truststore.location=/opt/security/pki/truststore.jks

After configuring the above settings, restart the Kafka service (including broker and Connect). Once the restart is completed, it will start to operate in Kerberos and SSL mode.

Kafka Connector Use Cases

Acceldata ODP Kafka Connect offers support for the following connectors, which have been included in this release:

The following table describes the supported connector type and library versions:

Connector Name	Supported Type	Library Version
Pubsub	Source & Sink	1.2.0
MongoDB	Source & Sink	1.6.1
JDBC	Source & Sink	6.1.2
S3	Sink Only	2.6.0
Kinesis	Sink Only	0.0.8

Last updated on Jul 10, 2025

Was this page helpful?