DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Running a 180B Model on a Gaming Laptop: POCKET-Darwin-180B

Running a 180B Model on a Gaming Laptop: POCKET-Darwin-180B

Comments
2 min read
Strands Decider 2B vs LLM as a judge: a keyword regex tied the 2B

Strands Decider 2B vs LLM as a judge: a keyword regex tied the 2B

Comments
1 min read
Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

Kaggle Benchmarking Challenge Submission

Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

1
Comments 3
4 min read
Click blackberry, find apple

Click blackberry, find apple

Comments
6 min read
tiktoken Undercounts Claude Tokens: 37 of 418 Requests Blew the Limit

tiktoken Undercounts Claude Tokens: 37 of 418 Requests Blew the Limit

Comments
7 min read
Your AI support agent will invent a price it was never told — here's the 3-section fix

Your AI support agent will invent a price it was never told — here's the 3-section fix

Comments 3
5 min read
How I Built a Local RAG System That Catches Documentation Lies

How I Built a Local RAG System That Catches Documentation Lies

Comments
7 min read
Four numbers Ollama 0.40 gives you now, and which ones to trust

Four numbers Ollama 0.40 gives you now, and which ones to trust

Comments 1
5 min read
Four new models, one interface change: from chat completion to decision

Four new models, one interface change: from chat completion to decision

Comments
5 min read
What I Learned When Groq Deprecated the Model My Product Depended On

What I Learned When Groq Deprecated the Model My Product Depended On

Comments
3 min read
When Does a Question Need an Agent? RAG vs GraphRAG vs Agentic GraphRAG on TigerGraph

When Does a Question Need an Agent? RAG vs GraphRAG vs Agentic GraphRAG on TigerGraph

Comments
6 min read
20 hostile messages that find your AI agent's failure modes before your customers do

20 hostile messages that find your AI agent's failure modes before your customers do

Comments 1
4 min read
Tired of juggling multiple LLM API formats? I built a small gateway to fix it

Tired of juggling multiple LLM API formats? I built a small gateway to fix it

Comments 1
1 min read
Embedding Retrieval Versus Reranking for RAG Hallucination in Ask Your Docs Chatbots

Embedding Retrieval Versus Reranking for RAG Hallucination in Ask Your Docs Chatbots

Comments 1
7 min read
Why Continuous Batching Made My LLM Inference Engine Slower

Why Continuous Batching Made My LLM Inference Engine Slower

Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.