How to start with Confluent Cloud Kafka Connect

Generate an API key

You need to generate an API key and secret to act as username and password specific for kafka connect. Do not use the Kafka credentials you should already got, this won't work. This can be done using Confluent Cloud CLI tool: ccloud. Install it using the official documentation: https://docs.confluent.io/ccloud-cli/current/install.html
  • Login and select your environment if you have several of them:
1
$ ccloud login
2
$ ccloud environment
Copied!
  • Generate a key: write down the key & secret:
1
$ ccloud api-key create --resource cloud
2
+---------+------------------------------------------------------------------+
3
| API Key | ABCDEFKZBF56666 |
4
| Secret | ToMaHaWkjQ1bt7BxvdyFjaJ8j3nSokaAd83Nhan739snAiufIAfdk7fFAAnBKxai |
5
+---------+------------------------------------------------------------------+
Copied!
  • The API Key is the username, the Secret is the token

kafka connect URL

  • Get the ID of the environment where your cluster is located:
1
$ ccloud environment list 16:49:31
2
Id | Name
3
+-------------+------------+
4
env-1234 | staging
5
* env-6789 | production
Copied!
  • Get the ID of the kafka cluster :
1
ccloud environment use env-6789
2
ccloud kafka cluster list 16:21:10
3
Id | Name | Type | Provider | Region | Availability | Status
4
+-------------+----------------------+-------+----------+--------------+--------------+--------+
5
lkc-8888 | analytics-production | BASIC | gcp | europe-west4 | single-zone | UP
Copied!
  • Then build the kafka connection URL for this env-id cluster-id couple
1
https://api.confluent.cloud/connect/v1/environments/env-6789/clusters/lkc-8888/
Copied!

Configure Conduktor using this API key

Configure your Conduktor with all these elements, selecting Basic Auth to add the username/password:
Test for the Connectivity here, to ensure the API Key is ready, it may takes a few minutes!
Last modified 1mo ago