avrocat

A CLI tool for consuming events from Kafka, deserializing them with Avro schemas, and printing the output as JSON.

Usage

Usage: avrocat <command>

Flags:

  -V, --Version          Kafka version (default: 0.8.2.0)
  -b, --broker(s)        Bootstrap broker(s) (host[:port]), comma-separated (default: <none>)
  -d, --debug            enable debug logging (default: false)
  -o, --offset           The offset to start with. Can be `oldest` or `newest` (default: newest)
  -p, --partitions       The partitions to consume, can be 'all' or comma-separated numbers (default: all)
  -s, --schema           Path to avro schema file (default: <none>)
  -t, --topic            Topic to consume from (default: <none>)
  --strip-schema-id      Strip the 5-byte Confluent Schema Registry header before decoding (default: true)
  -S, --sasl             Enable SASL authentication (default: false)
  -U, --username         SASL username
  -P, --password         SASL password
  -M, --mechanism        SASL mechanism: PLAIN (default), SCRAM-SHA-256, SCRAM-SHA-512, OAUTHBEARER, GSSAPI

Commands:

  version  Show the version information.

By default, avrocat expects messages in the Confluent Schema Registry wire format (1 magic byte + 4-byte schema ID prefix). Pass --strip-schema-id=false to consume raw Avro messages without that header.

Docker

Build

It's not necessary to install Golang to run the script, just build the container using docker with the following command:

docker build -t avrocat .

Running

$ docker run --rm -ti --name avrocat \
    --privileged --network=host --pid=host \
    avrocat -b kafka.hmarques.dev.use1.com:9092 \
      -t <topic> \
      -s schema.avsc \
      -d