Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
How NGOs Can Use LLMs Without Getting Burned
ToRnaDo_O
ToRnaDo_O
ToRnaDo_O
Follow
for
BCC-Hub
Jun 29
How NGOs Can Use LLMs Without Getting Burned
#
ai
#
automation
#
llm
#
productivity
2
reactions
Comments
3
comments
12 min read
We Obsessed Over Gateway Latency for a Month. Then We Looked at the Actual Numbers.
Paul Twist
Paul Twist
Paul Twist
Follow
Jun 18
We Obsessed Over Gateway Latency for a Month. Then We Looked at the Actual Numbers.
#
discuss
#
ai
#
llm
#
infrastructure
2
reactions
Comments
1
comment
4 min read
Stop Pasting Your Code Into ChatGPT For Debugging—Run LLMs Locally Instead
Learn AI Resource
Learn AI Resource
Learn AI Resource
Follow
May 30
Stop Pasting Your Code Into ChatGPT For Debugging—Run LLMs Locally Instead
#
ai
#
llm
#
coding
#
productivity
1
reaction
Comments
Add Comment
4 min read
A six-concern production harness for Nemotron agents on Crusoe Managed Inference
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
A six-concern production harness for Nemotron agents on Crusoe Managed Inference
#
hermeschallenge
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
cachebench: stop finding out about prompt-cache regressions from the invoice
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
cachebench: stop finding out about prompt-cache regressions from the invoice
#
hermeschallenge
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
I needed a stable cache key for LLM requests. The hard part was the input list order.
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
I needed a stable cache key for LLM requests. The hard part was the input list order.
#
hermeschallenge
#
ai
#
llm
#
rust
Comments
Add Comment
4 min read
My LLM provider went down for 11 minutes. My code spent 4 of them in connect timeouts.
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
My LLM provider went down for 11 minutes. My code spent 4 of them in connect timeouts.
#
hermeschallenge
#
ai
#
llm
#
rust
Comments
Add Comment
4 min read
agenttap: see exactly what your LLM SDK sent to the wire, with API keys scrubbed
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
agenttap: see exactly what your LLM SDK sent to the wire, with API keys scrubbed
#
hermeschallenge
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
I shipped eight agent-stack repos in eight hours. Here's what made it possible.
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
I shipped eight agent-stack repos in eight hours. Here's what made it possible.
#
hermeschallenge
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
llmfleet: pool many agents' turns into one Batch API call and save 50 percent
Mukunda Rao Katta
Mukunda Rao Katta
Mukunda Rao Katta
Follow
May 25
llmfleet: pool many agents' turns into one Batch API call and save 50 percent
#
hermeschallenge
#
ai
#
llm
#
agents
Comments
Add Comment
4 min read
Compass v1.1.0 · we shipped a memory plugin that catches its own consumption drift
chunxiaoxx
chunxiaoxx
chunxiaoxx
Follow
May 26
Compass v1.1.0 · we shipped a memory plugin that catches its own consumption drift
#
llm
#
memory
#
mcp
#
agents
1
reaction
Comments
Add Comment
5 min read
We Let Sci-Fi Authors Code AI For Us
Raphaël Pinson
Raphaël Pinson
Raphaël Pinson
Follow
Jun 28
We Let Sci-Fi Authors Code AI For Us
#
ai
#
machinelearning
#
llm
#
scifi
2
reactions
Comments
Add Comment
4 min read
What 'Bring Your Own Model' (BYOK) Actually Means When You Adopt AI at Work
Hanako H.
Hanako H.
Hanako H.
Follow
Jun 18
What 'Bring Your Own Model' (BYOK) Actually Means When You Adopt AI at Work
#
ai
#
llm
#
startup
#
productivity
Comments
Add Comment
4 min read
.klickd v4.0.0 — Portable AI memory with constraints, strict schemas, and test vectors
Davincc77
Davincc77
Davincc77
Follow
May 25
.klickd v4.0.0 — Portable AI memory with constraints, strict schemas, and test vectors
#
showdev
#
ai
#
architecture
#
llm
Comments
Add Comment
6 min read
The Human in the Loop Doesn't Scale. I Kept Him Anyway.
Joseph Yeo
Joseph Yeo
Joseph Yeo
Follow
Jun 28
The Human in the Loop Doesn't Scale. I Kept Him Anyway.
#
agents
#
ai
#
automation
#
llm
1
reaction
Comments
2
comments
6 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account