# Conduktor Documentation

## Docs

- [Kafka proxy and governance](https://docs.conduktor.io/gateway.md): Conduktor Gateway is a transparent Kafka proxy that enforces encryption, governance policies, traffic control, data masking, and multi-tenancy.
- [Kafka cost allocation and chargeback](https://docs.conduktor.io/guide/conduktor-concepts/chargeback.md): Track and allocate Kafka infrastructure costs to teams with Conduktor Chargeback. Measure bytes produced/consumed per service account, or track storage.
- [Kafka data products and governance](https://docs.conduktor.io/guide/conduktor-concepts/data-products.md): Build governed Kafka data products with Conduktor: combine self-service ownership, schema enforcement, topic policies, and resource metadata.
- [Kafka data quality — validation rules and policies](https://docs.conduktor.io/guide/conduktor-concepts/data-quality-policies.md): Define Kafka data quality rules using CEL expressions or JSON Schema. Attach policies to topics to observe violations or enforce blocking with Conduktor.
- [Gateway authentication and authorization](https://docs.conduktor.io/guide/conduktor-concepts/gateway-authentication-authorization.md): Configure Kafka client authentication in Conduktor Gateway: Gateway-managed mode with local service accounts and Kafka-managed mode with delegated auth.
- [Gateway service accounts](https://docs.conduktor.io/guide/conduktor-concepts/gateway-service-accounts.md): Manage Kafka client identities in Conduktor Gateway. Use local service accounts for isolated access or external accounts from OIDC, mTLS.
- [Indexing](https://docs.conduktor.io/guide/conduktor-concepts/indexing.md): Console Indexing collects Kafka metadata every 30 seconds into internal tables for topic sorting, filtering, and labelling.
- [Kafka interceptors — Gateway plugins for security and governance](https://docs.conduktor.io/guide/conduktor-concepts/interceptors.md): Conduktor Gateway interceptors enforce Kafka encryption, data quality, access control, and traffic control without changing client code.
- [Logical topics](https://docs.conduktor.io/guide/conduktor-concepts/logical-topics.md): Create logical Kafka topics in Conduktor Gateway: alias topics for renaming, concentrated topics to reduce partition costs, and SQL or CEL filter topics.
- [Kafka data sharing with partners](https://docs.conduktor.io/guide/conduktor-concepts/partner-zones.md): Share Kafka topics with external partners without data duplication using Conduktor Partner Zones.
- [Kafka self-service — topic requests and governed access](https://docs.conduktor.io/guide/conduktor-concepts/self-service.md): Enable dev teams to create Kafka topics and manage access through a governed self-service portal. Conduktor enforces policies, ACLs, and ownership.
- [Kafka rate limiting and traffic control](https://docs.conduktor.io/guide/conduktor-concepts/traffic-control-policies.md): Enforce Kafka rate limits, producer quotas, and topic rules with Conduktor Gateway. Protect cluster infrastructure from misbehaving clients without application changes.
- [Kafka multi-tenancy with Virtual Clusters — Gateway](https://docs.conduktor.io/guide/conduktor-concepts/virtual-clusters.md): Create isolated Kafka Virtual Clusters for teams, environments, or partners with Conduktor Gateway.
- [Kafka audit logging — track all actions](https://docs.conduktor.io/guide/conduktor-in-production/admin/audit-logs.md): Configure Kafka audit logs in Conduktor Console to track every user action and resource event.
- [Kafka cluster configuration](https://docs.conduktor.io/guide/conduktor-in-production/admin/configure-clusters.md): Add, update, and manage Kafka cluster configurations in Conduktor Console. Connect to Kafka brokers, Schema Registry, and Kafka Connect from the Settings. Enjoy a better experience with Confluent, Aiven and Gateway special integrations.
- [Kafka data masking and PII protection](https://docs.conduktor.io/guide/conduktor-in-production/admin/data-masking.md): Define Kafka data masking policies in Conduktor Console to protect PII and sensitive fields. Control who sees unmasked values based on RBAC permissions.
- [Kafka data validation policies](https://docs.conduktor.io/guide/conduktor-in-production/admin/gateway-policies.md): Validate Kafka producer records with Conduktor Gateway policies. Define CEL rules, JSON Schema checks, or Schema ID validation to block or flag invalid records.
- [Admin configuration — Conduktor Console setup](https://docs.conduktor.io/guide/conduktor-in-production/admin/index.md): Admin setup for Conduktor Console: connect Kafka clusters, configure RBAC, set up SSO, manage users and groups, enable audit logging, and configure data masking.
- [Kafka RBAC — role-based access control](https://docs.conduktor.io/guide/conduktor-in-production/admin/set-up-rbac.md): Set up Kafka RBAC in Conduktor Console to control access to topics, consumer groups, and resources.
- [SSO configuration in Conduktor Console — LDAP and OIDC](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/configure-sso.md): Set up SSO in Conduktor Console with LDAP or OIDC. Configuration examples for Okta, Azure AD, and external group mapping from your identity provider.
- [Delegated JWT authentication](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/delegated-jwt-authentication.md): Configure delegated JWT authentication in Conduktor Console to validate tokens from an external identity provider and grant access via single sign-on.
- [Authentication options](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/index.md): Configure authentication for Conduktor Console: local admin users, LDAP, OIDC, or delegated JWT. Choose the method that fits your identity provider.
- [Local admin and user management](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/local-admin-users.md): Create and manage local admin users in Conduktor Console. Add users via the UI, config file, or environment variables.
- [Map external groups](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/map-external-groups.md): Map LDAP or OIDC groups to Conduktor Console RBAC groups. Users inherit permissions at login and lose access when removed from the external group.
- [Session timeout configuration](https://docs.conduktor.io/guide/conduktor-in-production/admin/user-access/session-lifetime.md): Configure session timeout and idle session time in Conduktor Console. Set maximum session lifetime and access token duration for user authentication.
- [Conduktor REST API — Console and Gateway automation](https://docs.conduktor.io/guide/conduktor-in-production/automate/api-automation.md): Automate Conduktor using the Console and Gateway REST APIs. Manage users, groups, permissions, clusters.
- [Integrate with Backstage](https://docs.conduktor.io/guide/conduktor-in-production/automate/backstage-integration.md)
- [Conduktor CLI — automate Kafka with command line](https://docs.conduktor.io/guide/conduktor-in-production/automate/cli-automation.md): Manage Conduktor Console and Gateway resources from the CLI or CI/CD pipelines. Apply, get, and delete Kafka resources declaratively with the Conduktor CLI.
- [Conduktor automation — CLI, Terraform, and REST API](https://docs.conduktor.io/guide/conduktor-in-production/automate/index.md): Automate Conduktor Console and Gateway with the CLI, Terraform provider, or REST API. Manage users, topics, permissions.
- [Kafka MCP server for AI assistants](https://docs.conduktor.io/guide/conduktor-in-production/automate/mcp.md): Connect AI assistants to Kafka via Conduktor's MCP server. Query topics, consumer groups, and schema registry in natural language using Claude or compatible MCP clients.
- [Kafka Terraform provider — Conduktor](https://docs.conduktor.io/guide/conduktor-in-production/automate/terraform-automation.md): Manage Conduktor Console resources as code with the Conduktor Terraform provider. Declare topics, users, permissions, and Gateway configs in HCL.
- [Conduktor Console environment variables reference](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-console/environment-variables.md): Complete reference for Conduktor Console environment variables: logging, database, authentication, monitoring.
- [Deploy Console with Docker, Kubernetes, Helm](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-console/index.md): Deploy Conduktor Console with Docker, Kubernetes (Helm), or docker-compose. Requires PostgreSQL. Covers TLS, environment variables, memory tuning, and proxy configuration.
- [Conduktor Console on Kubernetes — Helm deployment guide](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-console/kubernetes.md): Deploy Conduktor Console on Kubernetes using the Helm chart. Covers Helm repo setup, PostgreSQL requirements, and reference architecture for production.
- [PostgreSQL sizing for Conduktor Console production](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-console/postgres-sizing.md): Size PostgreSQL for Conduktor Console in production on AWS, GCP, or Azure. Covers CPU, RAM, disk IOPS.
- [Conduktor Console configuration examples](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-console/sample-configuration.md): Console configuration examples: use API/CLI/Terraform for GitOps production, Console UI for quick changes.
- [Cortex deployment for Conduktor Console monitoring](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-cortex.md): Deploy conduktor-console-cortex for Kafka monitoring in Conduktor Console. Includes Prometheus and Alertmanager.
- [External monitoring setup](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-external-monitoring.md): Connect Conduktor Console to an existing Cortex, Mimir, or Prometheus stack. Available since Console v1.38 as alternative to deploying the Cortex.
- [Configure Gateway client connections](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/client-connections.md): Configure how Kafka clients connect to Conduktor Gateway. Choose from PLAINTEXT, SSL, SASL_PLAINTEXT or SASL_SSL security protocols for your network requirements. Decide whether authentication & authorization should be managed by Gateway or delegated to Kafka.
- [Connect Gateway to Kafka](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/connect-to-kafka.md): Configure the connection between Conduktor Gateway and your Kafka cluster. Set security protocols, authentication credentials.
- [Conduktor Gateway environment variables reference](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/environment-variables.md): Complete reference for Conduktor Gateway environment variables: network routing, Kafka connection, security, Virtual Clusters.
- [Kafka disaster recovery with Gateway failover](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/failover.md): Configure Conduktor Gateway to redirect Kafka clients to a secondary cluster during disaster recovery, without restarting or reconfiguring Kafka clients.
- [Deployment considerations](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/index.md): Deploy Conduktor Gateway: choose network routing, load balancing, Kafka connection, and client security before deploying to Docker or Kubernetes.
- [Conduktor Gateway on Kubernetes — Helm deployment](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/kubernetes.md): Deploy Conduktor Gateway on Kubernetes using the official Helm chart.
- [Configure Gateway load balancing](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/load-balancing.md): Configure load balancing for Conduktor Gateway nodes. Choose between internal Gateway load balancing or an external load balancer for Kafka client connections.
- [Conduktor Gateway multi-cluster setup](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/multi-clusters.md): Configure Conduktor Gateway to proxy multiple Kafka clusters from a single endpoint. Route clients to topics across clusters using topic aliases and access controls.
- [Configure multiple listeners (preview)](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/multiple-listeners.md): Set up multiple Gateway listeners with independent security protocols, routing strategies and network bindings.
- [Configure Gateway network routing](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/network.md): Choose the network routing method for Conduktor Gateway: port-based routing for simple setups or SNI routing for TLS environments.
- [Enable Virtual Clusters in Gateway](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-gateway/virtual-clusters.md): Enable Virtual Clusters in Conduktor Gateway to create isolated logical Kafka environments on a single physical cluster.
- [Configure Schema Registry Proxy](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-schema-registry-proxy/configuration.md): Environment variables for configuring Schema Registry Proxy, including Kafka, authentication, SSL/TLS and observability settings.
- [Deploy Schema Registry Proxy](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-schema-registry-proxy/index.md): Deploy the Conduktor Schema Registry Proxy for authentication, authorization and observability on top of Confluent Schema Registry.
- [Troubleshoot Schema Registry Proxy](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/deploy-schema-registry-proxy/troubleshooting.md): Common issues and fixes for Schema Registry Proxy deployment and operation.
- [Conduktor component overview](https://docs.conduktor.io/guide/conduktor-in-production/deploy-artifacts/index.md): Conduktor platform components: Console for Kafka management UI, Gateway as Kafka proxy, Cortex for monitoring, and CLI for automation.
- [Conduktor deployment architecture](https://docs.conduktor.io/guide/conduktor-in-production/index.md): Deploy Conduktor Console and Gateway on Kubernetes (Helm) or Docker. Production architecture overview with deployment options for each platform component.
- [Community Edition](https://docs.conduktor.io/guide/conduktor-in-production/manage-licenses/community-edition.md): Conduktor Community Edition is the free self-hosted tier. Manage up to 3 Kafka clusters and 50 users with core Console features and no time limit.
- [Licensing overview](https://docs.conduktor.io/guide/conduktor-in-production/manage-licenses/index.md): Apply and manage your Conduktor license. Community Edition supports 3 Kafka clusters and 50 users.
- [Gateway monitoring & alerting recommendations](https://docs.conduktor.io/guide/conduktor-in-production/monitor/gateway_jmx_recommendations.md)
- [Monitoring setup for Conduktor Gateway and Console](https://docs.conduktor.io/guide/conduktor-in-production/monitor/index.md): Set up health monitoring for Conduktor Gateway and Console. Configure liveness and readiness endpoints, Prometheus metrics.
- [Conduktor technical requirements — Console and Gateway](https://docs.conduktor.io/guide/conduktor-in-production/system-requirements.md): Hardware, software, and dependency requirements for Conduktor Console and Gateway. Covers CPU, RAM, PostgreSQL versions, and supported Kafka providers.
- [Conduktor quick start — deploy Console with Docker Compose](https://docs.conduktor.io/guide/get-started.md): Get Conduktor Console running in minutes with Docker Compose. Includes a full Kafka stack (Redpanda, PostgreSQL) for testing features before a production.
- [Conduktor platform — get started](https://docs.conduktor.io/guide/index.md): Conduktor platform guide: deploy Console and Gateway, configure Kafka clusters, set up RBAC and SSO, manage resources, and automate with CLI, API.
- [Kafka topic cost control](https://docs.conduktor.io/guide/insights/cost-control.md): Identify Kafka topics consuming unnecessary storage with Conduktor Insights. Surface empty, stale, and tiny topics to reduce costs.
- [Governance for VIP](https://docs.conduktor.io/guide/insights/governance.md)
- [Kafka Insights dashboard](https://docs.conduktor.io/guide/insights/index.md): The Conduktor Insights dashboard identifies Kafka configuration risks, storage costs, governance gaps, and business-critical topics across your clusters.
- [Kafka configuration risk analysis](https://docs.conduktor.io/guide/insights/risk-analysis.md): Identify Kafka topic configuration risks that impact reliability. Conduktor Insights flags replication, partition, and retention problems before outages.
- [Monitor VIP Kafka topics](https://docs.conduktor.io/guide/insights/vip-topics.md): Identify business-critical Kafka topics in Conduktor Insights VIP Topics. Surface your highest-traffic topics by consumer group count and message volume.
- [Kafka management with Conduktor Console](https://docs.conduktor.io/guide/manage-kafka/index.md): Manage all Kafka resources with Conduktor Console: topics, consumer groups, brokers, Schema Registry, connectors.
- [Kafka broker monitoring — view cluster health in Console](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/brokers.md): View Kafka broker status, cluster version, partition distribution, and configuration drift in Conduktor Console.
- [Kafka consumer group monitoring](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/consumer-groups.md): Monitor Kafka consumer groups, track consumer lag per partition, reset offsets, and manage group membership with Conduktor Console.
- [Kafka Connect management](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/kafka-connect.md): Deploy, monitor, and manage Kafka Connect source and sink connectors from a single UI. Restart failed tasks, configure RBAC, and track connector status.
- [ksqlDB management — Conduktor Console](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/ksql-db.md): Manage ksqlDB clusters from Conduktor Console. Run streaming SQL queries, browse streams and tables, and control access with RBAC.
- [Kafka Schema Registry management](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/schema-registry.md): Manage Avro, Protobuf, and JSON schemas in your Kafka Schema Registry with Conduktor Console. Create subjects, browse versions.
- [Kafka ACLs and service accounts](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/service-accounts-acls.md): Manage Kafka service accounts and ACLs in Conduktor Console. View permissions per principal, create ACLs, and integrate with Confluent, Aiven.
- [Kafka topics — browse, produce, and consume in Console](https://docs.conduktor.io/guide/manage-kafka/kafka-resources/topics.md): Browse, create, and manage Kafka topics in Conduktor Console. Filter by cleanup policy, view partition details, and produce or consume messages.
- [Kafka alerts and notifications](https://docs.conduktor.io/guide/monitor-brokers-apps/alerts.md): Set up Kafka alerts in Conduktor Console for infrastructure and application changes. Integrate with Slack, MS Teams, email, or custom webhooks.
- [Kafka monitoring and observability](https://docs.conduktor.io/guide/monitor-brokers-apps/index.md): Monitor Kafka broker health, consumer lag, partition status, and throughput with Conduktor Console.
- [Advanced pattern support Interceptors](https://docs.conduktor.io/guide/reference/advanced-pattern-support.md): Advanced patterns in Conduktor Gateway Interceptors: cache data, handle large messages, filter topics with CEL or SQL, and concentrate topic partitions.
- [Console resources](https://docs.conduktor.io/guide/reference/console-reference.md): YAML resource definitions for Conduktor Console: users, groups, permissions, RBAC bindings, cluster configurations, and certificate management schemas.
- [Data quality Interceptors](https://docs.conduktor.io/guide/reference/data-quality.md): Data quality Interceptor reference for Conduktor Gateway: CEL expression rules, JSON Schema validation, and Schema ID checks for enforcing Kafka message quality.
- [Data security Interceptors](https://docs.conduktor.io/guide/reference/data-security.md): Data security Interceptor reference for Conduktor Gateway: field-level encryption, full payload encryption, data masking.
- [Gateway resources](https://docs.conduktor.io/guide/reference/gateway-reference.md): YAML resource definitions for Conduktor Gateway: Virtual Clusters, service accounts, Interceptors, and authentication configuration schemas with examples.
- [Overview](https://docs.conduktor.io/guide/reference/index.md): Complete resource reference for Conduktor Console and Gateway: YAML schemas, field definitions, and examples for Interceptors, Self-service.
- [Interceptor list](https://docs.conduktor.io/guide/reference/interceptor-reference.md): Full list of Conduktor Gateway Interceptors organized by category: data security, data quality, traffic control.
- [Conduktor's Kafka resources](https://docs.conduktor.io/guide/reference/kafka-reference.md): YAML resource definitions for managing Kafka with Conduktor CLI: topics, consumer groups, subjects, connectors, and cluster configuration schemas.
- [Metrics reference](https://docs.conduktor.io/guide/reference/metric-reference.md): Prometheus metrics exposed by Conduktor Console for Kafka resources and Console health. Use with Grafana, Cortex, Mimir.
- [Self-service resources](https://docs.conduktor.io/guide/reference/self-service-reference.md): YAML resource definitions for Conduktor Self-service: Applications, ApplicationInstances, and permission schemas for GitOps-driven Kafka governance.
- [Release archive](https://docs.conduktor.io/guide/release-notes/archive.md): Archive of older Conduktor Console and Gateway release notes. Review past features, bug fixes, and breaking changes for previous versions.
- [Supported releases](https://docs.conduktor.io/guide/release-notes/index.md): Latest Conduktor Console and Gateway release notes: new features, bug fixes, and breaking changes. Covers the current supported release window.
- [Get help or support](https://docs.conduktor.io/guide/support/index.md): Get help with Conduktor: contact support, raise tickets, join the Conduktor Slack community, or browse documentation for self-service help.
- [Conduktor version support policy](https://docs.conduktor.io/guide/support/supported-version-policy.md): Conduktor supports software releases for one calendar year after publication. Understand which Console and Gateway versions receive patches and security.
- [Third-party dependencies](https://docs.conduktor.io/guide/support/third-party-dependencies.md): Third-party software dependencies and open-source libraries used by Conduktor Console and Gateway.
- [Upgrade or migrate](https://docs.conduktor.io/guide/support/upgrade-guide.md): Upgrade Conduktor Console or Gateway to the latest version. Follow the monthly release cadence and upgrade no more than two versions apart at a time.
- [Kafka audit log topic configuration](https://docs.conduktor.io/guide/tutorials/configure-audit-log-topic.md): Configure a Kafka topic as the destination for Conduktor audit logs. Stream all Console and Gateway audit events to a topic for compliance and analysis.
- [Kafka Chargeback with Gateway — cost tracking setup](https://docs.conduktor.io/guide/tutorials/configure-chargeback-with-gateway.md): Set up Conduktor Chargeback with Gateway to measure bytes produced and consumed per service account.
- [Kafka Chargeback without Gateway — storage cost tracking](https://docs.conduktor.io/guide/tutorials/configure-chargeback-without-gateway.md): Configure Conduktor Chargeback without Gateway using direct Kafka metrics. Track storage usage and partition counts to allocate infrastructure costs.
- [Kafka encryption configuration](https://docs.conduktor.io/guide/tutorials/configure-encryption.md): Configure field-level and full payload encryption in Conduktor Gateway. Integrate with Vault, AWS KMS, Azure, and Fortanix.
- [Configure Partner Zone traffic analytics](https://docs.conduktor.io/guide/tutorials/configure-partner-zone-traffic-analytics.md): Enable traffic analytics for Conduktor Partner Zones. Track bytes produced and consumed per partner to monitor usage and enforce governance on shared.
- [SQL logical topics in Conduktor Gateway — filtering setup](https://docs.conduktor.io/guide/tutorials/configure-sql-topics.md): Create SQL logical topics in Conduktor Gateway to filter Kafka records using SQL expressions. Route only matching records to consumers without client.
- [Kafka crypto shredding — encryption key deletion in Gateway](https://docs.conduktor.io/guide/tutorials/crypto-shredding.md): Implement crypto shredding in Conduktor Gateway: delete encryption keys to make Kafka records unreadable.
- [Custom deserializers in Conduktor Console — AWS Glue, Apicurio](https://docs.conduktor.io/guide/tutorials/custom-deserializers.md): Configure custom deserializers in Conduktor Console to decode proprietary or non-standard Kafka message formats.
- [Conduktor Gateway log customization — config file setup](https://docs.conduktor.io/guide/tutorials/custom-logging.md): Customize Conduktor Gateway logging output using a config file. Configure log levels, appenders, and formats for structured logging in your production.
- [Conduktor deployment on AWS — Console and Gateway on ECS](https://docs.conduktor.io/guide/tutorials/deploy-aws.md): Deploy Conduktor Console and Gateway on AWS. Covers EC2, EKS, RDS PostgreSQL, and networking setup for a production-ready Kafka management platform.
- [Self-service quick start](https://docs.conduktor.io/guide/tutorials/get-started-with-self-service.md): Quick start guide for Conduktor Self-service: configure applications, request topic access, set up GitOps workflows.
- [Conduktor tutorial overview](https://docs.conduktor.io/guide/tutorials/index.md): Step-by-step Conduktor tutorials: deploy on AWS, configure encryption, set up Self-service, manage service accounts, configure Chargeback, and more.
- [Gateway service accounts and ACLs](https://docs.conduktor.io/guide/tutorials/manage-gateway-service-accounts.md): Manage Gateway service accounts and Kafka ACLs using the Conduktor CLI. Create local service accounts, assign permissions.
- [Migrate to Self-service managed Confluent Cloud RBAC role bindings](https://docs.conduktor.io/guide/tutorials/migrate-confluent-cloud-rbac.md): Migrate Conduktor Self-service to manage Confluent Cloud RBAC role bindings instead of Kafka ACLs. Step-by-step guide for Confluent Cloud environments.
- [Migrate Conduktor Gateway to new security mode — v3.10+](https://docs.conduktor.io/guide/tutorials/migrate-gateway-security.md): Migrate Conduktor Gateway authentication to GATEWAY_MANAGED or KAFKA_MANAGED mode. Guide for upgrading from deprecated DELEGATED_XXX security protocols.
- [Create Partner Zones using multi-cluster Gateway](https://docs.conduktor.io/guide/tutorials/partner-zone-multi-cluster.md): Create Conduktor Partner Zones on a multi-cluster Gateway. Share topics from multiple Kafka clusters with external partners through a single Gateway.
- [Reprocess messages](https://docs.conduktor.io/guide/tutorials/reprocess-kafka-messages.md): Reprocess Kafka messages in Conduktor Console: replay records from a topic offset to republish or recover data without custom code.
- [SNI routing](https://docs.conduktor.io/guide/tutorials/sni-routing.md): Configure SNI routing in Conduktor Gateway to expose a single port and route Kafka clients to brokers by hostname.
- [Kafka traffic control policies](https://docs.conduktor.io/guide/use-cases/apply-traffic-control-policies.md): Apply rate limiting, throttling, and traffic shaping to Kafka producers and consumers with Conduktor Gateway interceptors.
- [Cache Kafka records — Conduktor Gateway](https://docs.conduktor.io/guide/use-cases/cache-kafka-data.md): Cache Kafka records with a Conduktor Gateway interceptor to reduce broker load and improve consumer fetch performance.
- [Kafka chaos testing — simulate failures](https://docs.conduktor.io/guide/use-cases/chaos-testing.md): Test Kafka resilience by injecting failures, delays, and corrupted messages with Conduktor Gateway.
- [Use Chargeback with Gateway](https://docs.conduktor.io/guide/use-cases/chargeback-with-gateway.md): Track Kafka cost allocation across teams with Conduktor Chargeback and Gateway. Measure bytes produced and consumed per service account for accurate.
- [Use Chargeback without Gateway](https://docs.conduktor.io/guide/use-cases/chargeback-without-gateway.md): Track Kafka storage and partition costs without Gateway using Conduktor Chargeback. Measure resource usage per cluster to allocate infrastructure costs.
- [Enforce Kafka data quality — intercept and reject bad messages](https://docs.conduktor.io/guide/use-cases/enforce-data-quality.md): Block or redirect invalid Kafka messages at the proxy layer with Conduktor Gateway. Define CEL or JSON Schema rules to reject bad data before it reaches.
- [Kafka alternative — manage any Kafka-compatible cluster](https://docs.conduktor.io/guide/use-cases/kafka-alternative.md): Conduktor Console and Gateway work with any Kafka-compatible provider: Apache Kafka, Confluent, AWS MSK, Redpanda, Aiven, WarpStream, and more — no.
- [Kafka field-level and payload encryption](https://docs.conduktor.io/guide/use-cases/kafka-encryption.md): Encrypt Kafka messages at field level or full payload with Conduktor Gateway interceptors. Integrates with Vault, AWS KMS, Azure, and GCP.
- [Kafka management — topics, consumers, and clusters](https://docs.conduktor.io/guide/use-cases/kafka-management.md): Manage Kafka topics, consumer groups, brokers, Schema Registry, and Kafka Connect from one platform.
- [Large Kafka message handling — offload to cloud storage](https://docs.conduktor.io/guide/use-cases/manage-large-messages.md): Handle oversized Kafka messages by offloading payloads to S3, GCS, or Azure Blob with Conduktor Gateway.
- [Observe Kafka data quality — monitor violations in Console](https://docs.conduktor.io/guide/use-cases/observe-data-quality.md): Monitor Kafka data quality violations in real time with Conduktor Console. Track rule breaches, view violation metrics, and identify topics with poor.
- [Kafka Self-service — topic requests and governance](https://docs.conduktor.io/guide/use-cases/self-service.md): Set up Kafka Self-service in Conduktor: let teams request topics via a portal, automate ACL approvals, and enforce governance through GitOps workflows.
- [Share Kafka data externally](https://docs.conduktor.io/guide/use-cases/third-party-data.md): Share Kafka data securely with external partners using Conduktor Partner Zones. Control topic access, apply data masking, and isolate partner traffic.
- [Apache Kafka Management Platform](https://docs.conduktor.io/index.md): Deploy, govern and automate Apache Kafka with Conduktor — manage clusters, secure data, track costs, and enable team self-service with Console and Gateway.
- [Kafka advertised host setting](https://docs.conduktor.io/learn/administration/advertised-host.md): advertised.listeners is the address brokers advertise to clients — the most common source of connection failures in Docker and multi-host setups.
- [Kafka cluster setup overview](https://docs.conduktor.io/learn/administration/cluster-setup.md): Planning a production Kafka cluster — broker count, availability zone placement, disk sizing, OS-level tuning and cloud vs on-premise trade-offs.
- [Kafka administration](https://docs.conduktor.io/learn/administration/index.md): Operating Kafka in production — cluster setup, TLS/SASL security, JMX monitoring, MirrorMaker replication, rolling upgrades and listener configuration.
- [Kafka monitoring and operations](https://docs.conduktor.io/learn/administration/monitoring.md): Kafka monitoring with JMX and third-party tools — the broker, producer and consumer metrics that matter most, plus rolling restart procedures.
- [Kafka multi-cluster and MirrorMaker](https://docs.conduktor.io/learn/administration/multi-cluster.md): MirrorMaker 2 for cross-cluster replication — active-active vs active-passive topologies, offset translation and disaster recovery patterns.
- [Kafka security](https://docs.conduktor.io/learn/administration/security.md): By default Kafka has no security. Add TLS encryption, SASL authentication (PLAIN, SCRAM) and ACL-based authorization for production deployments.
- [Kafka broker and client upgrades](https://docs.conduktor.io/learn/administration/upgrades.md): Upgrade Kafka brokers and clients independently with rolling restarts — API versioning and step-by-step zero-downtime upgrade procedure.
- [Consumer auto offset reset behavior](https://docs.conduktor.io/learn/advanced/consumers/auto-offset-reset.md): auto.offset.reset — where consumers start reading when no committed offset exists. earliest vs latest vs none, with real failure scenarios.
- [Consumer read from closest replica](https://docs.conduktor.io/learn/advanced/consumers/closest-replica.md): Reduce cross-datacenter latency by reading from nearest replicas. Configure client.rack and replica.selector.class for rack-aware consumer routing.
- [Consumer poll and heartbeat settings](https://docs.conduktor.io/learn/advanced/consumers/consumer-important-settings.md): fetch.min.bytes, max.poll.records, heartbeat.interval.ms and session.timeout.ms — settings that control throughput, latency and group stability.
- [Delivery semantics for Kafka consumers](https://docs.conduktor.io/learn/advanced/consumers/delivery-semantics.md): At-most-once, at-least-once or exactly-once — your offset commit strategy decides which guarantee you get. Trade-offs and idempotent consumer patterns.
- [Consumer incremental rebalance and static group membership](https://docs.conduktor.io/learn/advanced/consumers/incremental-rebalance.md): Incremental cooperative rebalancing and static group membership with group.instance.id — two ways to cut consumer downtime during partition reassignment.
- [Advanced Kafka consumers](https://docs.conduktor.io/learn/advanced/consumers/index.md): Go beyond the basics — delivery semantics, auto.offset.reset, poll tuning, incremental rebalancing and rack-aware replica reads for Kafka consumers.
- [Kafka producer acks explained](https://docs.conduktor.io/learn/advanced/producers/acks-deep-dive.md): acks=0, acks=1 or acks=all — each producer acknowledgment mode makes a different durability vs throughput trade-off. ISR interaction and data loss risks.
- [Other advanced Kafka producer configurations](https://docs.conduktor.io/learn/advanced/producers/advanced-config.md): Fine-tune Kafka producers with buffer.memory, max.block.ms, delivery.timeout.ms and linger.ms for throughput, latency and backpressure control.
- [Kafka producer batching](https://docs.conduktor.io/learn/advanced/producers/batching.md): Kafka producer batching boosts throughput by grouping records before sending. batch.size, linger.ms and RecordAccumulator internals explained.
- [Kafka message compression](https://docs.conduktor.io/learn/advanced/producers/compression.md): snappy, lz4, gzip or zstd — pick the right Kafka compression algorithm. Throughput gains, CPU cost and how brokers handle decompression.
- [Idempotent Kafka producer](https://docs.conduktor.io/learn/advanced/producers/idempotent-producers.md): Idempotent producers guarantee no duplicate writes even under retries — how enable.idempotence, sequence numbers and producer epochs work together.
- [Advanced Kafka producers](https://docs.conduktor.io/learn/advanced/producers/index.md): Production-grade Kafka producers — acks, retries, idempotency, batching, compression and custom partitioners for high-throughput, reliable publishing.
- [Producer default partitioner and sticky partitioner](https://docs.conduktor.io/learn/advanced/producers/partitioners.md): How Kafka partitioners route messages — default key-hash partitioning, round-robin and the sticky partitioner with their ordering impact.
- [Kafka producer retries](https://docs.conduktor.io/learn/advanced/producers/retries.md): Producer retries recover from transient failures — retries, retry.backoff.ms, delivery.timeout.ms, ordering risks and idempotency.
- [Advanced Kafka topics](https://docs.conduktor.io/learn/advanced/topics/index.md): Kafka topic internals — segment files, indexes, log retention, compaction, replication factor, partition sizing and naming conventions.
- [Kafka topic internals: segments and indexes](https://docs.conduktor.io/learn/advanced/topics/internals-segments-indexes.md): Kafka topic internals including segment files, offset indexes, time indexes, segment rolling thresholds and storage tuning options.
- [How to send large messages in Apache Kafka](https://docs.conduktor.io/learn/advanced/topics/large-messages.md): Kafka's default 1 MB message limit can be raised — configure message.max.bytes, fetch.message.max.bytes and compression alternatives.
- [Kafka topic configuration: log compaction](https://docs.conduktor.io/learn/advanced/topics/log-compaction.md): Log compaction keeps the latest value per message key rather than deleting by age — compact cleanup policy, tombstone records and how the compactor works.
- [Kafka topic configuration: log retention](https://docs.conduktor.io/learn/advanced/topics/log-retention.md): Control how long Kafka keeps your data with retention.ms and retention.bytes — time-based vs size-based retention, cleanup policies and storage planning.
- [Kafka topic configuration: minimum in-sync replicas](https://docs.conduktor.io/learn/advanced/topics/min-in-sync-replicas.md): min.insync.replicas sets the floor for write acknowledgment when using acks=all — interaction with ISR and availability trade-offs.
- [Kafka topic naming conventions](https://docs.conduktor.io/learn/advanced/topics/naming-conventions.md): Kafka topic naming — character restrictions, length limits, delimiter choices, environment prefixes and patterns that scale across teams.
- [Kafka topics: choosing the replication factor and partition count](https://docs.conduktor.io/learn/advanced/topics/replication-partitions.md): Partition count drives parallelism; replication factor drives durability. Sizing guidelines, ordering implications and what happens when you change partitions.
- [How to change a Kafka topic configuration using the CLI](https://docs.conduktor.io/learn/advanced/topics/topic-configuration-cli.md): kafka-configs CLI — describe current topic settings, override with alter and remove custom configs with delete-config, with hands-on examples.
- [Kafka topic configuration: unclean leader election](https://docs.conduktor.io/learn/advanced/topics/unclean-leader-election.md): When all ISRs go offline, should Kafka stay unavailable or promote an out-of-sync replica? unclean.leader.election.enable — the risks and when it makes sense.
- [Kafka Connect CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/connect-cli.md): Kafka Connect standalone mode walkthrough using real-time Wikipedia changes — connector config, worker properties and reading the output topic.
- [Kafka consumer CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/consumer-cli.md): Read Kafka topic messages in the terminal with kafka-console-consumer — from-beginning flag, partition filtering, key and timestamp display.
- [Kafka consumer group management CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/consumer-group-management-cli.md): kafka-consumer-groups CLI — list groups, inspect consumer lag with describe, reset offsets to replay data and delete stale groups, with real examples.
- [Kafka consumer groups CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/consumer-groups-cli.md): See consumer group partition assignment in action — run multiple kafka-console-consumer instances sharing a group and watch load distribute across them.
- [Kafka CLI tutorials](https://docs.conduktor.io/learn/cli-tutorials/index.md): Put Kafka CLI tools to work — kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups and Kafka Connect, hands-on.
- [Kafka producer CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/producer-cli.md): Send messages to Kafka topics from the terminal with kafka-console-producer — key-value pairs, acks configuration and delivery verification.
- [Kafka topics CLI tutorial](https://docs.conduktor.io/learn/cli-tutorials/topics-cli.md): kafka-topics CLI in practice — create, list, describe, alter and delete topics with partition and replication options shown through real commands.
- [Kafka brokers](https://docs.conduktor.io/learn/fundamentals/brokers.md): Kafka brokers form the cluster backbone — storing partitions, electing leaders and serving requests. How bootstrap servers and broker discovery work.
- [Kafka consumer groups and offsets](https://docs.conduktor.io/learn/fundamentals/consumer-groups-offsets.md): Consumer groups split partitions across instances for parallel processing — partition assignment, offset commits, rebalancing and lag monitoring.
- [Kafka consumers](https://docs.conduktor.io/learn/fundamentals/consumers.md): Kafka consumers pull messages from topics via a poll loop. Deserialization, offset tracking and consumer group basics — everything to get started.
- [Kafka fundamentals](https://docs.conduktor.io/learn/fundamentals/index.md): Start here — topics, partitions, producers, consumers, brokers, replication and KRaft mode. The core concepts behind Apache Kafka.
- [Kafka KRaft mode](https://docs.conduktor.io/learn/fundamentals/kraft-mode.md): KRaft replaces ZooKeeper with a built-in Raft consensus protocol, simplifying Kafka deployments. Architecture changes, controller quorum and migration.
- [Kafka producers](https://docs.conduktor.io/learn/fundamentals/producers.md): How Kafka producers write messages to topics — message keys, serializers, partitioning strategies and acknowledgment modes explained.
- [Kafka topic replication](https://docs.conduktor.io/learn/fundamentals/topic-replication.md): What happens when a Kafka broker fails? Replication, ISR and leader election keep your data safe — acks settings and durability trade-offs explained.
- [Kafka topics](https://docs.conduktor.io/learn/fundamentals/topics.md): Kafka topics organize data into partitions with sequential, immutable offsets — the foundation of ordering, parallelism and replay in Kafka.
- [What is Apache Kafka?](https://docs.conduktor.io/learn/fundamentals/what-is-apache-kafka.md): Apache Kafka is an open-source distributed event streaming platform used for real-time data pipelines, streaming analytics and system integration.
- [ZooKeeper with Kafka](https://docs.conduktor.io/learn/fundamentals/zookeeper.md): ZooKeeper's role in Kafka cluster coordination, its architectural limitations and why KRaft is replacing it in modern Kafka deployments.
- [How to start Kafka using Docker](https://docs.conduktor.io/learn/getting-started/docker-setup.md): Run Kafka with Docker Compose on any OS — single-broker KRaft config, compose file walkthrough and how to verify the cluster is up.
- [How to install Apache Kafka on Linux](https://docs.conduktor.io/learn/getting-started/install-linux.md): Step-by-step: install Apache Kafka with ZooKeeper on Linux — Java requirements, binary download, starting ZooKeeper and broker, and CLI smoke test.
- [How to install Apache Kafka on Linux without ZooKeeper (KRaft mode)](https://docs.conduktor.io/learn/getting-started/install-linux-kraft.md): Install Kafka on Linux without ZooKeeper using KRaft mode — Java setup, storage formatting with kafka-storage and single-node cluster verification.
- [How to install Apache Kafka on Mac](https://docs.conduktor.io/learn/getting-started/install-mac.md): Install Apache Kafka with ZooKeeper on macOS — Java prerequisites, binary download, starting both services and verifying with the CLI.
- [How to install Apache Kafka on Mac with Homebrew](https://docs.conduktor.io/learn/getting-started/install-mac-homebrew.md): Get Kafka running on macOS — brew install, managing ZooKeeper and broker as background services, CLI verification.
- [How to install Apache Kafka on Mac without ZooKeeper (KRaft mode)](https://docs.conduktor.io/learn/getting-started/install-mac-kraft.md): Run Kafka on macOS without ZooKeeper — KRaft mode setup from binary download through storage formatting to a verified single-node broker.
- [How to install Apache Kafka on Windows](https://docs.conduktor.io/learn/getting-started/install-windows.md): Install Kafka on Windows via WSL2 — WSL2 configuration, Java setup, starting ZooKeeper and the broker, and confirming the cluster with CLI tools.
- [How to install Apache Kafka on Windows without ZooKeeper (KRaft mode)](https://docs.conduktor.io/learn/getting-started/install-windows-kraft.md): KRaft-mode Kafka on Windows via WSL2 — no ZooKeeper needed. WSL2, Java, storage formatting and a working single-node broker in minutes.
- [Start learning Kafka with Conduktor](https://docs.conduktor.io/learn/getting-started/start-with-conduktor.md): Conduktor Console gives you a hosted Kafka cluster with no local setup — create topics, produce messages and explore the ecosystem through a visual UI.
- [Learn Apache Kafka](https://docs.conduktor.io/learn/index.md): Free Apache Kafka learning hub — fundamentals, installation, CLI tools, Java programming and advanced configurations from first principles to production.
- [Advanced Kafka Consumer tutorials with Java](https://docs.conduktor.io/learn/programming/advanced-kafka-consumer-java.md): Advanced Java consumer patterns for production — rebalance listeners, seek and assign for offset control, and multi-threaded consumer architectures.
- [Complete Kafka Consumer with Java](https://docs.conduktor.io/learn/programming/complete-kafka-consumer-java.md): A complete Java Kafka consumer with group coordination, offset commits and graceful shutdown — KafkaConsumer, poll loop and shutdown hook wired together.
- [Complete Kafka producer with Java](https://docs.conduktor.io/learn/programming/complete-kafka-producer-java.md): A complete Java Kafka producer with callbacks and message keys — KafkaProducer setup, ProducerRecord construction, async send and key-based partition routing.
- [Kafka Java programming](https://docs.conduktor.io/learn/programming/index.md): Build real Kafka applications in Java — project setup, SDK selection, producer callbacks, consumer groups, rebalance listeners and threading patterns.
- [Java Kafka programming](https://docs.conduktor.io/learn/programming/java-kafka-programming.md): Your starting point for Kafka Java development — project setup, kafka-clients dependency and your first working producer and consumer.
- [Creating a Kafka Java Project using Gradle (build.gradle)](https://docs.conduktor.io/learn/programming/kafka-java-project-gradle.md): Set up a Gradle project for Kafka Java development in IntelliJ — build.gradle with kafka-clients and SLF4J logging configured and ready to use.
- [Creating a Kafka Java Project using Maven (pom.xml)](https://docs.conduktor.io/learn/programming/kafka-java-project-maven.md): Set up a Maven project for Kafka Java development in IntelliJ — pom.xml with kafka-clients and SLF4J logging configured and ready to use.
- [Kafka SDK list](https://docs.conduktor.io/learn/programming/sdk-list.md): Kafka client libraries across languages — official Java SDK, plus Python, Go, .NET, Node.js and other community clients with maturity and feature notes.
- [Kafka UI and management](https://docs.conduktor.io/platform.md): Conduktor Console is a Kafka UI for managing topics, consumer groups, Schema Registry, and Kafka Connect. Monitor, secure, and govern your Kafka clusters.

## OpenAPI Specs

- [openapi](https://docs.conduktor.io/api-reference/openapi.json)

## Optional

- [Kafkademy](https://learn.conduktor.io/kafka/)
- [Support portal](https://support.conduktor.io)