DEV Community 👩‍💻👨‍💻

Piyush Kumar
Piyush Kumar

Posted on

Help needed regarding apache kafka golang

Hi all, I am currently working on Apache Kafka using go/golang confluent library. I have some doubts regarding consumer and its APIs.

  1. I am using pause and resume APIs of the library and doing manual commits. Let's say, I send 100 messages and without committing, I paused consumer and resume it afterward. I notice it didn't consume those 100 messages again but it started consuming the latest messages. Is this an expected behavior? If yes, is there a way to consume those 100 messages again.

  2. When I am resuming the consumers, after some processing, I am doing manual commit. I noticed the return offset committed is -1001 for a partition. I am not able to understand why it is happening and what it means? Did I lose all the data or the commit failed?

  3. Can someone please explain to me auto.offset.reset - latest and earliest?


Top comments (0)

Top Heroku Alternatives (For Free!)

Recently Heroku shut down free Heroku Dynos, free Heroku Postgres, and free Heroku Data for Redis on November 28th, 2022. So Meshv Patel put together some free alternatives in this classic DEV post.