DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why memory bandwidth matters more than TFLOPS for LLM inference

Why memory bandwidth matters more than TFLOPS for LLM inference

Comments
3 min read
Fix Qwen3.8-Max Flutter Performance Debug: 25% FPS Drop

Fix Qwen3.8-Max Flutter Performance Debug: 25% FPS Drop

Comments
8 min read
Three AI Labs Admit Their Agents Cheat and Break Into Things. Nobody Blinked.

Three AI Labs Admit Their Agents Cheat and Break Into Things. Nobody Blinked.

1
Comments 3
3 min read
LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

Comments 3
4 min read
Stop Waiting for the Full AI Response: Stream Tokens in Python

Stop Waiting for the Full AI Response: Stream Tokens in Python

Comments
2 min read
Small language models (1B–3B): what they're good for after fine-tuning

Small language models (1B–3B): what they're good for after fine-tuning

Comments
3 min read
Instruction tuning vs domain adaptation: two different fine-tuning goals

Instruction tuning vs domain adaptation: two different fine-tuning goals

Comments
3 min read
MCP Tool Descriptions Are Instructions, Not Metadata -- and That Is the Exploit

MCP Tool Descriptions Are Instructions, Not Metadata -- and That Is the Exploit

1
Comments 3
5 min read
QLoRA hyperparameters that actually matter (rank, alpha, learning rate, epochs)

QLoRA hyperparameters that actually matter (rank, alpha, learning rate, epochs)

Comments
3 min read
LoRA vs QLoRA vs full fine-tuning: cost, quality and when each makes sense

LoRA vs QLoRA vs full fine-tuning: cost, quality and when each makes sense

Comments
3 min read
OPSEC for Agents: Scope, Caps, Monitoring, and Kill Switches

OPSEC for Agents: Scope, Caps, Monitoring, and Kill Switches

Comments 1
4 min read
The Orchestrator's Deputy Has No Scope: Ambient Authority Is the Root Bug in Multi-Agent AI

The Orchestrator's Deputy Has No Scope: Ambient Authority Is the Root Bug in Multi-Agent AI

Comments 2
5 min read
Qwen3.8-Max Is Huge. The Agent Harness Still Decides

Qwen3.8-Max Is Huge. The Agent Harness Still Decides

5
Comments 1
3 min read
LLM Agent Sandboxes Have Two Escape Surfaces. Only One Gets CVEs.

LLM Agent Sandboxes Have Two Escape Surfaces. Only One Gets CVEs.

Comments 2
5 min read
5 Things That Make an AI Agent Actually Useful (Not Just Cool)

5 Things That Make an AI Agent Actually Useful (Not Just Cool)

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.