DEV Community

#llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
KVQuant: Run 70B LLMs on 8GB RAM with KV Cache Quantization

KVQuant: Run 70B LLMs on 8GB RAM with KV Cache Quantization

Comments
1 min read
How to Connect Your Local LLM with Web Search Data

How to Connect Your Local LLM with Web Search Data

Comments
12 min read
99% of Requests Failed and My Dashboard Showed Green

99% of Requests Failed and My Dashboard Showed Green

1
Comments 1
7 min read
Notification Hijacking: How WhatsApp and Slack Content Could Weaponize Google Gemini

Notification Hijacking: How WhatsApp and Slack Content Could Weaponize Google Gemini

1
Comments
5 min read
Agent Series (12): Agent Evaluation Framework — How Do You Know If Your Agent Is Actually Good?

Agent Series (12): Agent Evaluation Framework — How Do You Know If Your Agent Is Actually Good?

Comments
6 min read
RustyClaw: I'm rewriting an AI agent in Rust (because the meme demands it)

RustyClaw: I'm rewriting an AI agent in Rust (because the meme demands it)

Comments
7 min read
Why 99% of What You Send to Claude Is Already Cached

Why 99% of What You Send to Claude Is Already Cached

Comments
7 min read
Madness Driven Design: Don Quixote, Sancho Panza, and Your AI Copilot

Madness Driven Design: Don Quixote, Sancho Panza, and Your AI Copilot

Comments
8 min read
My AI Read a JSON File from Disk 900 Times in a Loop (And Why No Linter Can Save You)

My AI Read a JSON File from Disk 900 Times in a Loop (And Why No Linter Can Save You)

Comments
6 min read
I'm paying $15 per million tokens to write 'fix: typo'

I'm paying $15 per million tokens to write 'fix: typo'

Comments
7 min read
Why My CLI Output Isn't XML (And How I Ended Up Reinventing TOON Without Knowing It)

Why My CLI Output Isn't XML (And How I Ended Up Reinventing TOON Without Knowing It)

Comments
6 min read
BitForge: Run LLMs on Microcontrollers

BitForge: Run LLMs on Microcontrollers

Comments
1 min read
Your Mac Has a Free LLM and You're Not Using It

Your Mac Has a Free LLM and You're Not Using It

Comments
5 min read
BitForge: Run LLMs on Microcontrollers

BitForge: Run LLMs on Microcontrollers

Comments
1 min read
150 Lines of Apologies Removed

150 Lines of Apologies Removed

Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.