DEV Community

# llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
We ported how brains manage the cost of thinking to LLM systems
spriterock profile

We ported how brains manage the cost of thinking to LLM systems

#opensource #ai #llm #localllm
Comments 2
9 min read
AI Agents write code that compiles, but they still lie to the user. Here is how to fix the pipeline
atripati profile

AI Agents write code that compiles, but they still lie to the user. Here is how to fix the pipeline

#agents #go #llm #ai
Comments
1 min read
I Benchmarked 47 LLM Providers Against Real Queries - Here's What I Found đź“Š
ad_man_cf946186dc71743c9b profile

I Benchmarked 47 LLM Providers Against Real Queries - Here's What I Found đź“Š

#ai #llm #opensource #performance
Comments
8 min read
TitanCore Core-1 – Trillion-parameter LLM training infra in C++/CUDA with ZeRO-3
sarkaragi profile

TitanCore Core-1 – Trillion-parameter LLM training infra in C++/CUDA with ZeRO-3

#showdev #cpp #llm #performance
Comments
1 min read
0% vs 50%: Making a RAG Agent Refuse to Hallucinate
member_2e5ba30f profile

0% vs 50%: Making a RAG Agent Refuse to Hallucinate

#ai #llm #rag #machinelearning
Comments 1
2 min read
Building and Running Llama.cpp on an Air-Gapped Mac
someoddcodeguy profile

Building and Running Llama.cpp on an Air-Gapped Mac

#ai #cpp #llm #opensource
Comments
3 min read
AIMO: AI Mention Optimization — The Discipline of Being Recommended by AI Assistants
septim_labs profile

AIMO: AI Mention Optimization — The Discipline of Being Recommended by AI Assistants

#ai #llm #marketing #product
Comments
6 min read
Multi-Agent Kill Switch: Why Stopping the Orchestrator Doesn't Stop the Swarm
lkelly profile
Logan for Waxell

Multi-Agent Kill Switch: Why Stopping the Orchestrator Doesn't Stop the Swarm

#ai #agents #architecture #llm
1
Comments 1
11 min read
I Built a Production-Oriented Multi-Provider AI Chatbot in Rust — Here's How
mihir_mohapatra profile

I Built a Production-Oriented Multi-Provider AI Chatbot in Rust — Here's How

#rust #backend #ai #llm
1
Comments 1
5 min read
How RAGScope Knows Which Chunks Your LLM Actually Used
siddharth_pandey_27 profile

How RAGScope Knows Which Chunks Your LLM Actually Used

#rag #opensource #observability #llm
Comments 2
4 min read
llama.cpp Optimizations & New Qwopus3.5-9B GGUF Model Boost Local AI Performance
soytuber profile
soy

llama.cpp Optimizations & New Qwopus3.5-9B GGUF Model Boost Local AI Performance

#ai #llm #selfhosted
Comments
3 min read
Managing LLM Token Limits in Long MDX Articles
merbayerp profile

Managing LLM Token Limits in Long MDX Articles

#mdx #llm #tokenmanagement #rag
Comments
5 min read
Why I used three different critic roles instead of one (and what the eval taught me)
bhj37193 profile

Why I used three different critic roles instead of one (and what the eval taught me)

#llm #python #ai #evaluation
Comments 2
6 min read
Show HN: Needle distilled Gemini tool calling into 26M parameters — technical read, zero hype
jtorchia profile

Show HN: Needle distilled Gemini tool calling into 26M parameters — technical read, zero hype

#english #typescript #llm #ialocal
Comments
8 min read
Fitting LLM Reply Suggestions Into Every Provider's Prompt Cache — Without Structured Output
shinji_shimizu_bb51276a5e profile

Fitting LLM Reply Suggestions Into Every Provider's Prompt Cache — Without Structured Output

#llm #ai #rust #webdev
Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.