DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Designing MCP Tools for a 7B Model, Not a 70B One

Batching fix for small local models

Designing MCP Tools for a 7B Model, Not a 70B One

5
Comments 9
5 min read
Structured output broke on us three times. The third time taught us operator-ready.

Structured output broke on us three times. The third time taught us operator-ready.

Comments
4 min read
LLM-as-a-Judge: Âżpuede reemplazar el criterio de una persona?

LLM-as-a-Judge: Âżpuede reemplazar el criterio de una persona?

Comments
6 min read
Trusting an LLM's JSON in production

Trusting an LLM's JSON in production

Comments 2
6 min read
AI agent security: a threat model for autonomous agents

AI agent security: a threat model for autonomous agents

Comments 1
2 min read
MCP Tool Bloat Hits Local Models Harder: A Constraint Worth Talking About

MCP Tool Bloat Hits Local Models Harder: A Constraint Worth Talking About

1
Comments 1
3 min read
I Tested 7 AI Memory Products for Portability - All 7 Lock You In

I Tested 7 AI Memory Products for Portability - All 7 Lock You In

4
Comments 1
21 min read
Kimi K3 is the largest open-weight model ever released — and you probably still can't run it

Kimi K3 is the largest open-weight model ever released — and you probably still can't run it

7
Comments
2 min read
OpenAI Just Solved a Problem Open Since 1999. It Still Can't Ask Its Own Question.

Verified by top mathematicians for $2k

OpenAI Just Solved a Problem Open Since 1999. It Still Can't Ask Its Own Question.

25
Comments 14
4 min read
Prompt Engineering Explained Simply: 5 Techniques to Improve Your LLM Outputs

Prompt Engineering Explained Simply: 5 Techniques to Improve Your LLM Outputs

1
Comments
5 min read
Cache Misses — Why Your AI Costs Won’t Drop (Even When Traffic Stays Flat)

Cache Misses — Why Your AI Costs Won’t Drop (Even When Traffic Stays Flat)

1
Comments
2 min read
LLMs locales para agentes de cĂłdigo: lo que YouTube no te cuenta

LLMs locales para agentes de cĂłdigo: lo que YouTube no te cuenta

Comments
3 min read
Running a 27B Model with 16 GB: Bonsai 2-Bit on M1

Running a 27B Model with 16 GB: Bonsai 2-Bit on M1

Comments
4 min read
Low-Cost vs Premium Models: What’s the Real-World Gap?

Low-Cost vs Premium Models: What’s the Real-World Gap?

Comments
1 min read
Cheap Filters First, LLM Last: Running an AI Matcher Inside a Cron Job

Solves explosive LLM costs with boring code

Cheap Filters First, LLM Last: Running an AI Matcher Inside a Cron Job

5
Comments 8
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.