kafka server: Offset's topic has not yet been created

Question

I'm using Kafka server 0.9 + zookeper. I'm new with Kafka. It's running in virtualbox , I can connect to it using public IP so it's working ... more or less: can get topics and messages. So for now I have 2 issues:
I can't find anything at __consumer_offsets (empty) and that's why I've got issue with the go simple consumer script throwing error: kafka server: Offset's topic has not yet been created; when i check at zookeeper-shell.sh console by command ls /brokers/topics/__consumer_offsets it errors me : Node does not exist: /brokers/topics/__consumer_offsets
(maybe they are connected) I've got minor warning when autocreating topic: WARN  NetworkClient - Error while fetching metadata with correlation id 4157 : {topicName=LEADER_NOT_AVAILABLE}

Any help it highly appreciated. Thanks!

Chris Gregori · Accepted Answer

The __consumer_offsets topic is created automatically when a consumer using a group connects to the cluster. By default, Sarama does not support groups (https://github.com/Shopify/sarama/wiki/Frequently-Asked-Questions#how-can-i-use-sarama-to-monitor-or-join-a-consumer-group), so unless you are using the cluster extension (https://github.com/bsm/sarama-cluster) this is expected. You can use the kafka-console-consumer.sh tool that comes with Kafka to create it if you want.

Go Language

Similar Questions

How to compare arrays in Go language?

What is difference between := and = operators in Go?

How to create a kafka consumer group in Golang with Sarama?

On a mission to build Next-Gen Community Platform for Developers

Facebook

Twitter

Linkedin

Instagram