DEV Community: Piyush Kumar

Help needed regarding apache kafka golang

Piyush Kumar — Wed, 26 Jun 2019 18:20:33 +0000

Hi all, I am currently working on Apache Kafka using go/golang confluent library. I have some doubts regarding consumer and its APIs.

I am using pause and resume APIs of the library and doing manual commits. Let's say, I send 100 messages and without committing, I paused consumer and resume it afterward. I notice it didn't consume those 100 messages again but it started consuming the latest messages. Is this an expected behavior? If yes, is there a way to consume those 100 messages again.
When I am resuming the consumers, after some processing, I am doing manual commit. I noticed the return offset committed is -1001 for a partition. I am not able to understand why it is happening and what it means? Did I lose all the data or the commit failed?
Can someone please explain to me auto.offset.reset - latest and earliest?

Thanks

Best and worst about go/golang

Piyush Kumar — Mon, 24 Jun 2019 14:47:09 +0000

Hi all, It’s been 2 months I am working in go. I am curious to know what you guys find good and bad about go language.
Also, I am looking for some go open source projects to contribute.

Thanks

Best resources for learning cloud and distributed computing?

Piyush Kumar — Tue, 03 Jul 2018 05:17:11 +0000

Hi, I want to develop applications pertaining to cloud and distributed computing architecture. I have some basic theoretical knowledge of cloud. I have looked into internet but not able to find cumulative resources explaining steps and guidelines with proper sample projects.

So, can anyone suggest some good resources(books/online courses/articles) that will help me seriously dive into cloud computing field?

Thanks
Piyush