DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
MiniMax M3.1 Flash: How a 428B MoE Model Cuts Agentic AI Costs by 70% Without Sacrificing Performance

MiniMax M3.1 Flash: How a 428B MoE Model Cuts Agentic AI Costs by 70% Without Sacrificing Performance

Comments
5 min read
How to Summarize Large Logistics Documents with an LLM API Batch or Streaming

How to Summarize Large Logistics Documents with an LLM API Batch or Streaming

Comments
7 min read
Summarize Large Documents with an LLM API — Batch vs Streaming Best Approach

Summarize Large Documents with an LLM API — Batch vs Streaming Best Approach

Comments
6 min read
The harness is not the model: what you pick with an agentic CLI

The harness is not the model: what you pick with an agentic CLI

Comments
13 min read
Calling open models inside a TEE with the OpenAI Python SDK

Calling open models inside a TEE with the OpenAI Python SDK

Comments
2 min read
LLMOps Is Supply Chain Work: Pinning the Inputs You Don't Control

LLMOps Is Supply Chain Work: Pinning the Inputs You Don't Control

Comments
5 min read
Local AI in 2026: What One 24 GB GPU Can Actually Run

Local AI in 2026: What One 24 GB GPU Can Actually Run

Comments
3 min read
Coverage Is Not Capability: What Whisper Taught Me About African Speech

Coverage Is Not Capability: What Whisper Taught Me About African Speech

1
Comments
5 min read
The hidden prompt tokens in cheap LLM APIs

The hidden prompt tokens in cheap LLM APIs

Comments
3 min read
The case for on-prem LLMs in security scanning

The case for on-prem LLMs in security scanning

Comments
1 min read
How we built an AI buyer that pushes back (instead of agreeing with you)

How we built an AI buyer that pushes back (instead of agreeing with you)

1
Comments 1
6 min read
We audited 134,522 posts to see why AI writing still sounds fake (and open-sourced a deterministic syntactic gate)

We audited 134,522 posts to see why AI writing still sounds fake (and open-sourced a deterministic syntactic gate)

Comments
3 min read
The real cost of "just add RAG"

The real cost of "just add RAG"

Comments
4 min read
vLLM prefix caching on vs off: 7.5x the throughput with a 4,000-token system prompt on one L40S

vLLM prefix caching on vs off: 7.5x the throughput with a 4,000-token system prompt on one L40S

Comments 2
6 min read
Tiered Context: A Knowledge Hierarchy for AI Agents

Tiered Context: A Knowledge Hierarchy for AI Agents

Comments
15 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.