Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Why INT4 Weight-Only Quantization Doesn't Speed Up Prefill
jidonglab
jidonglab
jidonglab
Follow
Jul 31
Why INT4 Weight-Only Quantization Doesn't Speed Up Prefill
#
llm
#
machinelearning
#
performance
Comments
1
 comment
7 min read
Why I made my eval tool refuse to give a score
Ashwin Ugale
Ashwin Ugale
Ashwin Ugale
Follow
Sep 3
Why I made my eval tool refuse to give a score
#
ai
#
llm
#
testing
#
python
6
 reactions
Comments
Add Comment
2 min read
What are the leading dedicated AI agent memory layer platforms?
Edward Izgorodin
Edward Izgorodin
Edward Izgorodin
Follow
Sep 3
What are the leading dedicated AI agent memory layer platforms?
#
ai
#
agents
#
llm
#
mcp
3
 reactions
Comments
4
 comments
6 min read
Deploying Inference Using NVIDIA Dynamo and vLLM
Sanskriti Harmukh
Sanskriti Harmukh
Sanskriti Harmukh
Follow
for
Vultr
Sep 3
Deploying Inference Using NVIDIA Dynamo and vLLM
#
nvidia
#
vllm
#
llm
#
gpu
13
 reactions
Comments
Add Comment
8 min read
I Built an AI That Rewrites Its Own Prompts — Its Safety Gate Rejected Every Single Edit
Debashish Ghosal
Debashish Ghosal
Debashish Ghosal
Follow
Sep 1
I Built an AI That Rewrites Its Own Prompts — Its Safety Gate Rejected Every Single Edit
#
ai
#
promptengineering
#
llm
#
agents
24
 reactions
Comments
7
 comments
8 min read
Why Most AI Agents Fail in Production: 10 Architecture Mistakes Engineers Make
RAJSHREE
RAJSHREE
RAJSHREE
Follow
Sep 3
Why Most AI Agents Fail in Production: 10 Architecture Mistakes Engineers Make
#
ai
#
agents
#
llm
#
architecture
1
 reaction
Comments
Add Comment
9 min read
Everyone's Trying Vectors and Graphs for AI Memory. We Went Back to SQL.
Priyesh Dave
Priyesh Dave
Priyesh Dave
Follow
Aug 23
Everyone's Trying Vectors and Graphs for AI Memory. We Went Back to SQL.
#
ai
#
agenticai
#
machinelearning
#
llm
Comments
1
 comment
4 min read
CI/CD for Agentic AI: Freezing Production Failures Into Hermetic Regression Tests With Tracely-ai
Priyesh Dave
Priyesh Dave
Priyesh Dave
Follow
Aug 23
CI/CD for Agentic AI: Freezing Production Failures Into Hermetic Regression Tests With Tracely-ai
#
ai
#
agenticai
#
machinelearning
#
llm
Comments
Add Comment
5 min read
The Two-Hour Gatekeeper for a 'Cheap and Capable' Model Announcement
Emery Li
Emery Li
Emery Li
Follow
Aug 14
The Two-Hour Gatekeeper for a 'Cheap and Capable' Model Announcement
#
ai
#
testing
#
llm
#
programming
1
 reaction
Comments
Add Comment
4 min read
Tracely: Turning Real Production Agent Failures into Hermetic Regression Tests
Priyesh Dave
Priyesh Dave
Priyesh Dave
Follow
Aug 23
Tracely: Turning Real Production Agent Failures into Hermetic Regression Tests
#
ai
#
agenticai
#
machinelearning
#
llm
Comments
Add Comment
4 min read
Anthropic's Opus 5 Release Is About Production Engineering, Not Just Performance
albe_sf
albe_sf
albe_sf
Follow
Jul 31
Anthropic's Opus 5 Release Is About Production Engineering, Not Just Performance
#
ai
#
llm
#
claude
#
machinelearning
Comments
1
 comment
2 min read
Open LLM Gateway: self-hosted LLM control plane (proxy + analytics + admin UI, no seat cap)
Nelson Lin
Nelson Lin
Nelson Lin
Follow
Sep 3
Open LLM Gateway: self-hosted LLM control plane (proxy + analytics + admin UI, no seat cap)
#
showdev
#
ai
#
llm
#
llmops
1
 reaction
Comments
3
 comments
2 min read
DiffusionGemma Is Fast Because It Stops Pretending Text Has to Be Written Left to Right
Reid Marlow
Reid Marlow
Reid Marlow
Follow
Aug 4
DiffusionGemma Is Fast Because It Stops Pretending Text Has to Be Written Left to Right
#
discuss
#
ai
#
llm
#
programming
3
 reactions
Comments
Add Comment
3 min read
Your LLM pricing page is probably wrong — here's how I automated mine
jjen0206
jjen0206
jjen0206
Follow
Aug 4
Your LLM pricing page is probably wrong — here's how I automated mine
#
showdev
#
github
#
actions
#
llm
1
 reaction
Comments
Add Comment
3 min read
Your context window bills you every turn
Ferhat AtagĂĽn
Ferhat AtagĂĽn
Ferhat AtagĂĽn
Follow
Sep 3
Your context window bills you every turn
#
claude
#
anthropic
#
llm
#
observability
Comments
1
 comment
5 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account