DEV Community

izycoinssupport
izycoinssupport

Posted on

Kafka optimization for Streaming Market Data

Hi All, Please help !!!!
We are currently facing latency.. Basically we are getting streaming market data from Binance and publishing into Kafka instance, According to my dev Kafka is adding an additional latency to each message up to 20/ms per msg. Please note that we are targeting to consume the msg as fast as possible within micro or nanoseconds. Please find attached my kafka config key values used for realtime:

Topics :
Nb partition=3

Producer :
Batch.size =1
linger_ms = 0
acks = 0

Consumer :
fetch.min.bytes = 1
fetch.max.wait.bytes ms = 0

Please advise..

Top comments (0)