DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Doubling Qwen3.6-27B on One RTX 3090: ollama llama.cpp + MTP, Lever by Lever (35.7 ~75 tok/s)
sysoft profile

Doubling Qwen3.6-27B on One RTX 3090: ollama llama.cpp + MTP, Lever by Lever (35.7 ~75 tok/s)

#ollama #llm #performance #machinelearning
Comments
7 min read
Compass v1.1.0 · we shipped a memory plugin that catches its own consumption drift
chunxiaoxx profile

Compass v1.1.0 · we shipped a memory plugin that catches its own consumption drift

#llm #memory #mcp #agents
1
Comments
5 min read
OpenAI-compatible AI API gateway migration checklist
jacksoul_c3a27b9c8184 profile

OpenAI-compatible AI API gateway migration checklist

#llm #ai #api #webdev
Comments
4 min read
Design Your Own Multi-AI Coding Pipeline: A Portable Reference Architecture
yang_goufang_23c7ba674984 profile

Design Your Own Multi-AI Coding Pipeline: A Portable Reference Architecture

#ai #architecture #testing #llm
Comments
11 min read
設計你自己的 Multi-AI Coding Pipeline：一份可搬走的參考架構
yang_goufang_23c7ba674984 profile

設計你自己的 Multi-AI Coding Pipeline：一份可搬走的參考架構

#ai #architecture #testing #llm
Comments
1 min read
AI Weekly — 2026-05-29 to 2026-06-05 | The Gap Between Launch and Landing
yang_goufang_23c7ba674984 profile

AI Weekly — 2026-05-29 to 2026-06-05 | The Gap Between Launch and Landing

#ai #machinelearning #tech #llm
Comments
4 min read
The LLM API Failure Policy I Wish I Had Before My First Production Incident

Branching logic for RPM vs TPM rate limits
plasma_01 profile
plasma

The LLM API Failure Policy I Wish I Had Before My First Production Incident

#ai #llm #javascript #webdev
6
Comments 15
6 min read
The Data Pipeline Problems Nobody Mentions in AI Architecture Discussions
karan2598 profile

The Data Pipeline Problems Nobody Mentions in AI Architecture Discussions

#ai #llm #infrastructure #brainpackai
1
Comments
3 min read
How to test an OpenAI-compatible AI API gateway without rewriting your app
jacksoul_c3a27b9c8184 profile

How to test an OpenAI-compatible AI API gateway without rewriting your app

#ai #api #llm #webdev
Comments
4 min read
Beyond the Model: The Hidden Cost of Multi-Model Workflows
abdulaziz_zos profile

Beyond the Model: The Hidden Cost of Multi-Model Workflows

#agents #ai #llm #systemdesign
2
Comments
1 min read
SpaceXAI and Cursor to Launch Groundbreaking AI Model This Week
davekurian profile

SpaceXAI and Cursor to Launch Groundbreaking AI Model This Week

#news #ai #coding #llm
Comments
5 min read
Why most LLM VRAM calculators are wrong on modern models (and an open-source MIT fix)
_3b0a699f706f194486871 profile
Yo

Why most LLM VRAM calculators are wrong on modern models (and an open-source MIT fix)

#showdev #ai #opensource #llm
Comments
2 min read
I Built an Error Notebook for My AI Agent - 266 Rules, 66 Interceptions, and a Demo You Can Run
xinandeq profile

I Built an Error Notebook for My AI Agent - 266 Rules, 66 Interceptions, and a Demo You Can Run

#ai #llm #agents #devtools
1
Comments 4
10 min read
How to test an OpenAI-compatible AI API gateway without rewriting your app
jacksoul_c3a27b9c8184 profile

How to test an OpenAI-compatible AI API gateway without rewriting your app

#ai #webdev #api #llm
Comments
4 min read
What belongs in an agent's context window (and what to evict)
jacksonxly profile

What belongs in an agent's context window (and what to evict)

#ai #machinelearning #programming #llm
3
Comments 17
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.