DEV Community

# llm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Running OpenAI's gpt-oss-20b with 128k Context on a Single L4 GPU
ratibor78 profile

Running OpenAI's gpt-oss-20b with 128k Context on a Single L4 GPU

#ai #llm #kubernetes #devops
Comments
13 min read
Your AI speed benchmark is measuring the one workload you don't run
thousand_miles_ai profile

Your AI speed benchmark is measuring the one workload you don't run

#discuss #ai #llm #inference
Comments
3 min read
Your Tech Stack Has an AI Problem: How to Audit and Fix It in 2026
lycore profile

Your Tech Stack Has an AI Problem: How to Audit and Fix It in 2026

#ai #architecture #llm #softwareengineering
Comments
8 min read
RAG Series (21): Performance Optimization — Faster and Cheaper
wonderlab profile

RAG Series (21): Performance Optimization — Faster and Cheaper

#ai #rag #llm #performance
Comments
7 min read
How the itrstats tax assistant works: one query, every layer
kartikeyraj profile

How the itrstats tax assistant works: one query, every layer

#python #llm #agents #rag
Comments
10 min read
The Shai-Hulud Worm Is Now Open Source — Here's How to Stop Self-Replicating Prompts Before They Reach Your LLM
coridev profile

The Shai-Hulud Worm Is Now Open Source — Here's How to Stop Self-Replicating Prompts Before They Reach Your LLM

#security #llm #appsec #cybersecurity
1
Comments
5 min read
The Hype Correction
vystartasv profile

The Hype Correction

#ai #agents #llm #devtools
2
Comments
4 min read
Building llama.cpp from source on a Dell Precision T5820 with an RTX 3090 Ti (after seven power cycles)
ianlpaterson profile

Building llama.cpp from source on a Dell Precision T5820 with an RTX 3090 Ti (after seven power cycles)

#ai #llm #gpu #linux
Comments
16 min read
The LLM Kept Saying “Fixed.” For Three Months, It Wasn’t.
ianlpaterson profile

The LLM Kept Saying “Fixed.” For Three Months, It Wasn’t.

#ai #llm #testing #programming
Comments
7 min read
Inference Arbitrage: How I Route 200+ Daily LLM Calls Across Five Models
ianlpaterson profile

Inference Arbitrage: How I Route 200+ Daily LLM Calls Across Five Models

#ai #llm #devops #python
Comments
10 min read
Three Months of Speed-Up Experiments on a 3090 Ti: Autoregressive DFlash MTP for Qwen3.6-27B
ianlpaterson profile

Three Months of Speed-Up Experiments on a 3090 Ti: Autoregressive DFlash MTP for Qwen3.6-27B

#ai #llm #gpu #performance
Comments
18 min read
LLM Benchmark Rankings 2026: 15 Models Tested on 38 Real Coding Tasks
ianlpaterson profile

LLM Benchmark Rankings 2026: 15 Models Tested on 38 Real Coding Tasks

#ai #llm #programming #benchmarking
Comments
28 min read
How I Track Claude, Codex, and Gemini Quotas from One Script
ianlpaterson profile

How I Track Claude, Codex, and Gemini Quotas from One Script

#ai #llm #productivity #bash
Comments
6 min read
Designing a Multi-Agent AI System for Content Analysis and Recommendations
nagashreebhat profile

Designing a Multi-Agent AI System for Content Analysis and Recommendations

#systemdesign #llm #backend #ai
Comments
7 min read
A Practical Model Selection Matrix for Multi-Model AI Apps
ye_allen_ profile

A Practical Model Selection Matrix for Multi-Model AI Apps

#api #ai #openai #llm
Comments 1
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.