Skip to main content
Quick navigation

Chaos Simulate Message Corruption

This interceptor simulates message corruption by appending random bytes to messages produced.

This demo will run you through some of these use cases step-by-step.

View the full demo in realtime​

You can either follow all the steps manually, or watch the recording

Review the docker compose environment​

As can be seen from docker-compose.yaml the demo environment consists of the following services:

  • gateway1
  • gateway2
  • kafka-client
  • kafka1
  • kafka2
  • kafka3
  • schema-registry
cat docker-compose.yaml

Starting the docker environment​

Start all your docker processes, wait for them to be up and ready, then run in background

  • --wait: Wait for services to be running|healthy. Implies detached mode.
  • --detach: Detached mode: Run containers in the background
docker compose up --detach --wait

Creating topic with-random-bytes on gateway1​

Creating on gateway1:

  • Topic with-random-bytes with partitions:1 and replication-factor:1
kafka-topics \
    --bootstrap-server localhost:6969 \
    --replication-factor 1 \
    --partitions 1 \
    --create --if-not-exists \
    --topic with-random-bytes

Adding interceptor simulate-massage-corruption​

Let's create the interceptor, instructing Conduktor Gateway to simulate message corruption by appending random bytes to messages produced.

step-06-simulate-massage-corruption-interceptor.json:

{
  "kind" : "Interceptor",
  "apiVersion" : "gateway/v2",
  "metadata" : {
    "name" : "simulate-massage-corruption"
  },
  "spec" : {
    "comment" : "Adding interceptor: simulate-massage-corruption",
    "pluginClass" : "io.conduktor.gateway.interceptor.chaos.ProduceSimulateMessageCorruptionPlugin",
    "priority" : 100,
    "config" : {
      "topic" : "with-random-bytes",
      "sizeInBytes" : 10,
      "rateInPercent" : 100
    }
  }
}
curl \
    --silent \
    --request PUT "http://localhost:8888/gateway/v2/interceptor" \
    --header "Content-Type: application/json" \
    --user "admin:conduktor" \
    --data @step-06-simulate-massage-corruption-interceptor.json | jq

Listing interceptors​

Listing interceptors on gateway1

curl \
    --silent \
    --request GET "http://localhost:8888/gateway/v2/interceptor" \
    --user "admin:conduktor" | jq

Send message to our created topic​

Producing 1 message in with-random-bytes in cluster gateway1

Sending 1 event

{
  "message" : "hello world"
}
echo '{"message": "hello world"}' | \
    kafka-console-producer \
        --bootstrap-server localhost:6969 \
        --topic with-random-bytes

Let's consume the message, and confirm message was appended random bytes​

This should produce output similar to this:

{"message": "hello world"}T[�   �X�{�
kafka-console-consumer \
    --bootstrap-server localhost:6969 \
    --topic with-random-bytes \
    --from-beginning \
    --max-messages 2 \
    --timeout-ms 3000

Tearing down the docker environment​

Remove all your docker processes and associated volumes

  • --volumes: Remove named volumes declared in the "volumes" section of the Compose file and anonymous volumes attached to containers.
docker compose down --volumes

Conclusion

Yes, Chaos Simulate Message Corruption is simple as it!