Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
KVQuant: Run 70B LLMs on 8GB RAM with KV Cache Quantization
Aman Sachan
Aman Sachan
Aman Sachan
Follow
Apr 30
KVQuant: Run 70B LLMs on 8GB RAM with KV Cache Quantization
#
python
#
llm
#
quantization
Comments
Add Comment
1 min read
How to Connect Your Local LLM with Web Search Data
Tomás Murúa
Tomás Murúa
Tomás Murúa
Follow
for
SerpApi
Jun 4
How to Connect Your Local LLM with Web Search Data
#
ai
#
locallm
#
llm
#
serpapi
Comments
Add Comment
12 min read
99% of Requests Failed and My Dashboard Showed Green
NaveenKumar Namachivayam ⚡
NaveenKumar Namachivayam ⚡
NaveenKumar Namachivayam ⚡
Follow
May 13
99% of Requests Failed and My Dashboard Showed Green
#
ai
#
performance
#
llm
#
nvidia
1
 reaction
Comments
1
 comment
7 min read
Notification Hijacking: How WhatsApp and Slack Content Could Weaponize Google Gemini
Cor E
Cor E
Cor E
Follow
Jun 4
Notification Hijacking: How WhatsApp and Slack Content Could Weaponize Google Gemini
#
security
#
ai
#
llm
#
appsec
1
 reaction
Comments
Add Comment
5 min read
Agent Series (12): Agent Evaluation Framework — How Do You Know If Your Agent Is Actually Good?
WonderLab
WonderLab
WonderLab
Follow
Jun 4
Agent Series (12): Agent Evaluation Framework — How Do You Know If Your Agent Is Actually Good?
#
ai
#
agents
#
llm
#
skills
Comments
Add Comment
6 min read
RustyClaw: I'm rewriting an AI agent in Rust (because the meme demands it)
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
RustyClaw: I'm rewriting an AI agent in Rust (because the meme demands it)
#
rust
#
python
#
ai
#
llm
Comments
Add Comment
7 min read
Why 99% of What You Send to Claude Is Already Cached
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
Why 99% of What You Send to Claude Is Already Cached
#
llm
#
claude
#
anthropic
#
infrastructure
Comments
Add Comment
7 min read
Madness Driven Design: Don Quixote, Sancho Panza, and Your AI Copilot
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
Madness Driven Design: Don Quixote, Sancho Panza, and Your AI Copilot
#
ai
#
llm
#
rust
#
cli
Comments
Add Comment
8 min read
My AI Read a JSON File from Disk 900 Times in a Loop (And Why No Linter Can Save You)
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
My AI Read a JSON File from Disk 900 Times in a Loop (And Why No Linter Can Save You)
#
ai
#
llm
#
performance
#
swift
Comments
Add Comment
6 min read
I'm paying $15 per million tokens to write 'fix: typo'
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
I'm paying $15 per million tokens to write 'fix: typo'
#
swift
#
appleintelligence
#
git
#
llm
Comments
Add Comment
7 min read
Why My CLI Output Isn't XML (And How I Ended Up Reinventing TOON Without Knowing It)
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
Why My CLI Output Isn't XML (And How I Ended Up Reinventing TOON Without Knowing It)
#
llm
#
cli
#
rust
#
tokens
Comments
Add Comment
6 min read
BitForge: Run LLMs on Microcontrollers
Aman Sachan
Aman Sachan
Aman Sachan
Follow
Apr 30
BitForge: Run LLMs on Microcontrollers
#
llm
#
esp32
#
iot
#
python
Comments
Add Comment
1 min read
Your Mac Has a Free LLM and You're Not Using It
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
Your Mac Has a Free LLM and You're Not Using It
#
swift
#
appleintelligence
#
llm
#
macos
Comments
Add Comment
5 min read
BitForge: Run LLMs on Microcontrollers
Aman Sachan
Aman Sachan
Aman Sachan
Follow
Apr 30
BitForge: Run LLMs on Microcontrollers
#
llm
#
esp32
#
iot
#
python
Comments
Add Comment
1 min read
150 Lines of Apologies Removed
Fernando Rodriguez
Fernando Rodriguez
Fernando Rodriguez
Follow
Apr 30
150 Lines of Apologies Removed
#
ai
#
llm
#
cli
#
rust
Comments
Add Comment
6 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account