Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
MiniMax M3.1 Flash: How a 428B MoE Model Cuts Agentic AI Costs by 70% Without Sacrificing Performance
Prabhakar Chaudhary
Prabhakar Chaudhary
Prabhakar Chaudhary
Follow
Oct 23
MiniMax M3.1 Flash: How a 428B MoE Model Cuts Agentic AI Costs by 70% Without Sacrificing Performance
#
ai
#
machinelearning
#
llm
#
opensource
Comments
Add Comment
5 min read
Moderation
How to Summarize Large Logistics Documents with an LLM API Batch or Streaming
DorianReed2186
DorianReed2186
DorianReed2186
Follow
Oct 23
How to Summarize Large Logistics Documents with an LLM API Batch or Streaming
#
ai
#
llm
#
logistics
#
summarization
Comments
Add Comment
7 min read
Moderation
Summarize Large Documents with an LLM API — Batch vs Streaming Best Approach
ColeMitchell4991
ColeMitchell4991
ColeMitchell4991
Follow
Oct 23
Summarize Large Documents with an LLM API — Batch vs Streaming Best Approach
#
python
#
llm
#
documentprocessing
Comments
Add Comment
6 min read
Moderation
The harness is not the model: what you pick with an agentic CLI
Szymon Paluch
Szymon Paluch
Szymon Paluch
Follow
Oct 23
The harness is not the model: what you pick with an agentic CLI
#
ai
#
agents
#
claude
#
llm
Comments
Add Comment
13 min read
Moderation
Calling open models inside a TEE with the OpenAI Python SDK
VoltageGPU
VoltageGPU
VoltageGPU
Follow
Oct 23
Calling open models inside a TEE with the OpenAI Python SDK
#
ai
#
llm
#
privacy
#
python
Comments
Add Comment
2 min read
Moderation
LLMOps Is Supply Chain Work: Pinning the Inputs You Don't Control
skvrtyk
skvrtyk
skvrtyk
Follow
Oct 23
LLMOps Is Supply Chain Work: Pinning the Inputs You Don't Control
#
ai
#
llm
#
devops
#
python
Comments
Add Comment
5 min read
Moderation
Local AI in 2026: What One 24 GB GPU Can Actually Run
Abdullah
Abdullah
Abdullah
Follow
Oct 23
Local AI in 2026: What One 24 GB GPU Can Actually Run
#
ai
#
llm
#
opensource
#
programming
Comments
Add Comment
3 min read
Moderation
Coverage Is Not Capability: What Whisper Taught Me About African Speech
Bernard Abuto
Bernard Abuto
Bernard Abuto
Follow
Oct 27
Coverage Is Not Capability: What Whisper Taught Me About African Speech
#
ai
#
llm
#
machinelearning
#
openai
1
 reaction
Comments
Add Comment
5 min read
Moderation
The hidden prompt tokens in cheap LLM APIs
UplinkSwitch
UplinkSwitch
UplinkSwitch
Follow
Oct 23
The hidden prompt tokens in cheap LLM APIs
#
ai
#
llm
#
api
#
testing
Comments
Add Comment
3 min read
Moderation
The case for on-prem LLMs in security scanning
hugginf_expert
hugginf_expert
hugginf_expert
Follow
Oct 23
The case for on-prem LLMs in security scanning
#
security
#
llm
#
ai
#
devops
Comments
Add Comment
1 min read
Moderation
How we built an AI buyer that pushes back (instead of agreeing with you)
Kulissa
Kulissa
Kulissa
Follow
Oct 27
How we built an AI buyer that pushes back (instead of agreeing with you)
#
ai
#
voice
#
llm
#
startup
1
 reaction
Comments
1
 comment
6 min read
Moderation
We audited 134,522 posts to see why AI writing still sounds fake (and open-sourced a deterministic syntactic gate)
Adrian M. Peticila
Adrian M. Peticila
Adrian M. Peticila
Follow
Oct 23
We audited 134,522 posts to see why AI writing still sounds fake (and open-sourced a deterministic syntactic gate)
#
ai
#
llm
#
opensource
#
writing
Comments
Add Comment
3 min read
Moderation
The real cost of "just add RAG"
Rishi Makwana
Rishi Makwana
Rishi Makwana
Follow
Oct 23
The real cost of "just add RAG"
#
rag
#
ai
#
architecture
#
llm
Comments
Add Comment
4 min read
Moderation
vLLM prefix caching on vs off: 7.5x the throughput with a 4,000-token system prompt on one L40S
Runcrate
Runcrate
Runcrate
Follow
Oct 27
vLLM prefix caching on vs off: 7.5x the throughput with a 4,000-token system prompt on one L40S
#
vllm
#
llm
#
gpu
#
performance
Comments
2
 comments
6 min read
Moderation
Tiered Context: A Knowledge Hierarchy for AI Agents
Rost
Rost
Rost
Follow
Oct 23
Tiered Context: A Knowledge Hierarchy for AI Agents
#
knowledgemanagement
#
ai
#
llm
#
architecture
Comments
Add Comment
15 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account