The Kafka connector integrates seamlessly with Apache Kafka, enabling efficient data streaming and event processing. It offers robust capabilities for secure, scalable, and real-time data exchange.
Authentication
Before you begin integration, ensure you have the following information:
Connection Name: Choose a meaningful name for your connection. This name helps you identify the connection within your application or integration settings. It could be something descriptive like "MyAppKafkaIntegration".Bootstrap Server URLs: Broker server URLs separated by a comma (","). Eg: kafka-broker-001:9092,kafka-broker-002:9092Endpoint(Deprecated): The Kafka brokers' IP address or DNS name.Port Number(Depracated): The port on which your Kafka server listens for connections. Default value: 9094.Database Username: The authenticated user with the permissions to read tables in your database.Database Password: The password for the database user.Topic Prefix: The prefix to filter topics by. Leave blank to fetch all topics.Properties: Kafka connections often require advanced configurations through key-value pairs to tailor the connection to specific security protocols and operational needs. These properties can be set here.Key: The property key. Kafka-specific configuration options can be set here. Example: “sasl.mechanism”.Value: The value for the specified property key. Example: “PLAIN”.
SSL Secure: Enable this option to Connect over an SSL-encrypted connection.Client Certificate: Obtain a valid client certificate from a trusted Certificate Authority (CA). This certificate authenticates your client to the database server.SSL Certificate Key: This private key corresponds to your client certificate.Server Certificate: Obtain the database server's SSL certificate. This certificate verifies the server's identity to your client. Often provided by your database administrator or hosting service.
Actions
Actions | Description |
| Bulk Create records in Kafka |
| Commit offsets in Kafka |
| Create a record in Kafka |
| Creates a topic in Kafka |
| Gets group metadata from Kafka |
| Gets topic metadata from Kafka |
| Polls for new records from Kafka topic |
Triggers
Triggers | Description |
| Triggers on record in Kafka |