DEV Community

Discussion on: Defluffer - reduce token usage 📉 by 45% using this one simple trick! [Earthday challenge]

Collapse
 
ingosteinke profile image
Ingo Steinke, web developer

At the same time, people add more system prompts to explicitly require what only seemed self-evident: correct code, current language levels and software versions, let the AI check sources and documentation instead of hallucinating etc.

Currently everyone seems to build stuff on top of existing AI systems to optimize them to become more correct, more efficient, more whatever. Doctoring the symptoms because we can't reach teh root cause. The whole idea of LLM seems to be build on fluffer in a way. And even concise input tends to produce verbose fluffy output.