DEV Community

One Billion Row Challenge in Golang - From 95s to 1.96s

Renato de Pontes Pereira on March 18, 2024

Introduction The One Billion Row Challenge (1BRC) is quite simple: the task is developing a program capable of read a file with 1 billio...
Collapse
 
egemengol profile image
Egemen Göl

Impressive and inspiring, kudos 👏

I wondered what was the flow that lent itself to use fnv, swissmap, custom integer parsing with one decimal etc. Was it mostly other performant solutions, just knowing how to google or previous practical knowledge?

Also, do multiple reader goroutines really need to synchronize? Cannot one just read files concurrently complementary of the OS? Dividing the file length to N and reading after seeking to that point in the file may work, what do you think?

Well written article, thanks again :)