Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
What running an LLM in production actually costs you
Oren Segal
Oren Segal
Oren Segal
Follow
Jul 16
What running an LLM in production actually costs you
#
llm
#
ai
#
devops
1
reaction
Comments
1
comment
5 min read
How OpenAI's Models Escaped a Sandbox and Breached Hugging Face
Yajur Agarwal
Yajur Agarwal
Yajur Agarwal
Follow
Aug 5
How OpenAI's Models Escaped a Sandbox and Breached Hugging Face
#
ai
#
cybersecurity
#
openai
#
llm
2
reactions
Comments
Add Comment
10 min read
More Context Made My Classifier Worse: Building a Machine-Maintained Failure Taxonomy
Akarsh hegde
Akarsh hegde
Akarsh hegde
Follow
Jul 2
More Context Made My Classifier Worse: Building a Machine-Maintained Failure Taxonomy
#
ai
#
llm
#
beginners
#
tutorial
Comments
Add Comment
4 min read
How I cut AI generation errors in half without burning more LLM calls
N4k3l
N4k3l
N4k3l
Follow
Jul 2
How I cut AI generation errors in half without burning more LLM calls
#
ai
#
automation
#
llm
#
sideprojects
Comments
Add Comment
3 min read
AI Agent Sandboxing: Contain the Blast Radius
Brenn Hill
Brenn Hill
Brenn Hill
Follow
Jul 25
AI Agent Sandboxing: Contain the Blast Radius
#
ai
#
security
#
llm
#
devops
2
reactions
Comments
2
comments
9 min read
Speculative Decoding: Faster On-Device LLMs
Raghu Bharadwaj
Raghu Bharadwaj
Raghu Bharadwaj
Follow
Aug 5
Speculative Decoding: Faster On-Device LLMs
#
machinelearning
#
llm
#
edgecomputing
#
linux
1
reaction
Comments
4
comments
6 min read
Your AI coding agent gets expensive one reasonable decision at a time
Nazarii Ahapevych
Nazarii Ahapevych
Nazarii Ahapevych
Follow
Jul 2
Your AI coding agent gets expensive one reasonable decision at a time
#
ai
#
llm
#
productivity
#
devops
Comments
Add Comment
3 min read
RAG Without Vectors: How LLMs Are Learning to Navigate Documents Like Humans
Shrividya Hegde
Shrividya Hegde
Shrividya Hegde
Follow
Jul 2
RAG Without Vectors: How LLMs Are Learning to Navigate Documents Like Humans
#
ai
#
architecture
#
llm
#
rag
Comments
Add Comment
6 min read
How I Built a 6-Agent AI Recruitment System on Qwen Cloud in less than 28 Days
Tochukwu Obinna
Tochukwu Obinna
Tochukwu Obinna
Follow
Jul 2
How I Built a 6-Agent AI Recruitment System on Qwen Cloud in less than 28 Days
#
showdev
#
agents
#
ai
#
llm
Comments
Add Comment
1 min read
Chunked Prefill: Why One Long Prompt Freezes Your LLM Server
jidonglab
jidonglab
jidonglab
Follow
Jul 3
Chunked Prefill: Why One Long Prompt Freezes Your LLM Server
#
ai
#
llm
#
performance
#
systemdesign
Comments
1
comment
7 min read
I Ran 1,000 LLM Evals Over 12 Months. Here's What Actually Moved the Needle
MrClaw207
MrClaw207
MrClaw207
Follow
Jul 2
I Ran 1,000 LLM Evals Over 12 Months. Here's What Actually Moved the Needle
#
ai
#
llm
#
agents
#
llmtools
Comments
Add Comment
4 min read
[AI] Optimizing vLLM Serving: AWQ, GPTQ, & GGUF | SLM Playbook
Tuấn Anh
Tuấn Anh
Tuấn Anh
Follow
Jul 2
[AI] Optimizing vLLM Serving: AWQ, GPTQ, & GGUF | SLM Playbook
#
machinelearning
#
ai
#
devops
#
llm
Comments
Add Comment
4 min read
We let an AI agent hit a database 1034 times. Text-to-SQL ran 23 unsafe ops. The policy layer ran zero
Dipankar Sarkar
Dipankar Sarkar
Dipankar Sarkar
Follow
Jul 2
We let an AI agent hit a database 1034 times. Text-to-SQL ran 23 unsafe ops. The policy layer ran zero
#
ai
#
python
#
llm
#
opensource
Comments
Add Comment
4 min read
What Really Concerns Me is One of the Biggest Issues with AI Coding Agents: Context Isolation and Task Coordination
ahlimosa-gif
ahlimosa-gif
ahlimosa-gif
Follow
Jul 25
What Really Concerns Me is One of the Biggest Issues with AI Coding Agents: Context Isolation and Task Coordination
#
ai
#
aiagents
#
softwareengineering
#
llm
Comments
Add Comment
6 min read
RAG en entreprise : ce que j'ai appris en le déployant chez un industriel (REX)
Victor Gless-Krumhorn
Victor Gless-Krumhorn
Victor Gless-Krumhorn
Follow
Jul 2
RAG en entreprise : ce que j'ai appris en le déployant chez un industriel (REX)
#
ai
#
rag
#
llm
#
machinelearning
Comments
Add Comment
4 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account