Skip to content

DEV Community

# llm

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Apr 30

KVQuant: Run 70B LLMs on 8GB RAM with 4-bit KV Cache Quantization

#python #llm #quantization #optimization

1 min read

Badri C

Apr 30

Securing Agentic Workflows: A Deterministic 'Human-in-the-Loop' Pattern for LLMs

#agents #architecture #llm #security

5 min read

Grega Snoj

May 4

I just wanted to chat with my Raspberry Pi.

#ai #python #raspberrypi #llm

9 min read

Jun 3

Introducing KORA: Open-Source AI Orchestration for Task Graphs

#showdev #ai #llm #opensource

2 min read

Apr 30

Fix Your Prompt Structure Before You Touch Your Infrastructure

#ai #llm #rag #machinelearning

4 min read

preeti deshmukh

Jun 3

The AI Tasks Developers Trust And the Ones They Double-Check

#ai #llm #productivity #softwaredevelopment

11 min read

Joud Awad

Jun 2

27/30 Days System Design Questions!

#systemdesign #distributedsystems #llm #rag

2 min read

ARY RABELO

Jun 2

I measured MCP vs a CLI for agent search. The MCP used 17x more tokens per call.

#mcp #ai #typescript #llm

6 min read

Apr 30

Why File-to-Markdown Conversion Is Becoming an AI Input Layer

#markitdown #llm #ai

7 min read

Jun 3

Function-calling eval was a 2024 problem. Tool-using agents are the 2026 one.

#ai #llm #agents #testing

5 min read

Jun 3

Running 35B–400B LLMs on a GPU-less Cluster to Mine 10,000 Papers — and the 4 Bugs That Almost Ruined the Data

#llm #machinelearning #python #infrastructure

9 min read

Apr 30

I Compressed GPT-2 to Run on an Arduino

#llm #embedded #tinyml #python

1 min read

WonderLab

Jun 3

Agent Series (11): A2A Protocol — How Agents Collaborate with Each Other

#agents #llm #opensource #multiagent

5 min read

Christopher Maher

Apr 29

TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max

#ai #llm #kubernetes #opensource

8 min read

Eli Hadam Zucker

Apr 29

Why I'm Building a Local-First AI Coding Workspace (And How Behavioral Routing Makes It Work)

#ai #rust #llm #webdev

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.