Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
llama-server's prompt cache reuses KV computed under a different LoRA scale
The Homelab Postmortem
The Homelab Postmortem
The Homelab Postmortem
Follow
Oct 9
llama-server's prompt cache reuses KV computed under a different LoRA scale
#
llamacpp
#
llm
#
selfhosted
#
lora
Comments
Add Comment
6 min read
Designing an AI Concierge That Qualifies Visitors With Facts You Publish
Taha Echakiri
Taha Echakiri
Taha Echakiri
Follow
for
NeticsLabs
Oct 10
Designing an AI Concierge That Qualifies Visitors With Facts You Publish
#
ai
#
automation
#
llm
#
devops
Comments
Add Comment
9 min read
Ten proofs, ten 97-99% scores, one rejection: what Verdikta's math bounties reveal about AI proof grading
drdz23
drdz23
drdz23
Follow
Oct 9
Ten proofs, ten 97-99% scores, one rejection: what Verdikta's math bounties reveal about AI proof grading
#
ai
#
math
#
llm
#
web3
Comments
Add Comment
4 min read
Only 3% of the Brain Wakes Up: The Mixture-of-Experts Playbook Behind September's Biggest Models
Daniel Sam Pete Thiyagu
Daniel Sam Pete Thiyagu
Daniel Sam Pete Thiyagu
Follow
Oct 8
Only 3% of the Brain Wakes Up: The Mixture-of-Experts Playbook Behind September's Biggest Models
#
ai
#
machinelearning
#
deeplearning
#
llm
Comments
Add Comment
6 min read
The Definition Is the Kernel. What Still Runs After the People and the Model Change Is the Asset.
zxpmail
zxpmail
zxpmail
Follow
Oct 13
The Definition Is the Kernel. What Still Runs After the People and the Model Change Is the Asset.
#
ai
#
architecture
#
llm
#
agents
2
 reactions
Comments
Add Comment
9 min read
Build a chatbot that actually remembers context (and win from a 2,500 prize pool!) đ§ đ¤
Rohit
Rohit
Rohit
Follow
Oct 9
Build a chatbot that actually remembers context (and win from a 2,500 prize pool!) đ§ đ¤
#
ai
#
devchallenge
#
llm
#
web3
Comments
Add Comment
1 min read
The Agent That Trapped Itself: How Context Eviction and Deduplication Broke on a Go Project
Kuro-shi Somemaru
Kuro-shi Somemaru
Kuro-shi Somemaru
Follow
Oct 12
The Agent That Trapped Itself: How Context Eviction and Deduplication Broke on a Go Project
#
ai
#
llm
#
agents
#
automation
Comments
5
 comments
7 min read
Azure AI Foundry Cost Optimization: Caching & KV-Cache Reuse
Amitesh0512
Amitesh0512
Amitesh0512
Follow
Oct 9
Azure AI Foundry Cost Optimization: Caching & KV-Cache Reuse
#
azureaifoundry
#
costoptimization
#
performancetuning
#
llm
Comments
Add Comment
7 min read
Why Most AI Startups Will Fail at the Same Problem Nobody Is Talking About
AI Bug Slayer đ
AI Bug Slayer đ
AI Bug Slayer đ
Follow
Oct 9
Why Most AI Startups Will Fail at the Same Problem Nobody Is Talking About
#
aiagents
#
ai
#
llm
#
webdev
Comments
Add Comment
4 min read
A Field Guide to RAG Failure Modes: Garbled Scans, Duplicate Chunks, and Leaky Indexes
Uglypear Data
Uglypear Data
Uglypear Data
Follow
Oct 13
A Field Guide to RAG Failure Modes: Garbled Scans, Duplicate Chunks, and Leaky Indexes
#
ai
#
llm
#
machinelearning
#
rag
Comments
2
 comments
6 min read
Your LiteLLM master key is also your admin UI password: a hardening checklist for self-hosted LiteLLM
munimv2
munimv2
munimv2
Follow
Oct 13
Your LiteLLM master key is also your admin UI password: a hardening checklist for self-hosted LiteLLM
#
llm
#
security
#
selfhosted
#
abotwrotethis
Comments
1
 comment
4 min read
A Mixed-Language Test Set for WhatsApp Assistants in Gulf Businesses
Ujjwal Dubey
Ujjwal Dubey
Ujjwal Dubey
Follow
Oct 9
A Mixed-Language Test Set for WhatsApp Assistants in Gulf Businesses
#
whatsapp
#
testing
#
llm
#
nlp
Comments
Add Comment
2 min read
Vector database showroom. Part 3 Qdrant â The Hot Hatchback That Carries More Than It Looks
Silver_dev
Silver_dev
Silver_dev
Follow
Oct 8
Vector database showroom. Part 3 Qdrant â The Hot Hatchback That Carries More Than It Looks
#
ai
#
llm
#
database
#
learning
Comments
Add Comment
3 min read
Semantic Caching for LLM Calls in Node.js With pgvector
Geminate Solutions
Geminate Solutions
Geminate Solutions
Follow
Oct 9
Semantic Caching for LLM Calls in Node.js With pgvector
#
node
#
postgres
#
llm
#
ai
Comments
Add Comment
6 min read
Your LLM Types One Token at a Time. It Doesn't Have To.
Daniel Sam Pete Thiyagu
Daniel Sam Pete Thiyagu
Daniel Sam Pete Thiyagu
Follow
Oct 8
Your LLM Types One Token at a Time. It Doesn't Have To.
#
ai
#
llm
#
machinelearning
#
programming
Comments
Add Comment
5 min read
đ
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account