DEV Community

Discussion on: I Tested Chunking on Docs, PDFs, and Code. The Winner Changed Every Time.

Collapse
 
ranjancse profile image
Ranjan Dailata

I was chunking the documents same like you and later realized it was the biggest mistake of my life. Hence, I decided to write up a blog post regarding the same.

why-chunking-is-the-biggest-mistak...

Collapse
 
ayanarshad02 profile image
Md Ayan Arshad

Haha yeah it's one of those things that looks like a solved problem until you actually measure it, would love to read your post, always good to have more real experiment data out there on this