Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
localllm
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
What really fits in 8GB VRAM
the kilted dev
the kilted dev
the kilted dev
Follow
Aug 18
What really fits in 8GB VRAM
#
localllm
#
vram
#
gpu
#
buildinpublic
Comments
Add Comment
7 min read
Moving Scheduled LLM Curation from Cloud APIs to Local Models
Guatu
Guatu
Guatu
Follow
Aug 14
Moving Scheduled LLM Curation from Cloud APIs to Local Models
#
aiagents
#
localllm
#
ollama
#
kubernetes
Comments
Add Comment
9 min read
Nine ways to talk to a local model
the kilted dev
the kilted dev
the kilted dev
Follow
Aug 11
Nine ways to talk to a local model
#
localllm
#
ollama
#
llamacpp
#
buildinpublic
Comments
Add Comment
9 min read
Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model
uehara
uehara
uehara
Follow
Aug 10
Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model
#
ai
#
llm
#
machinelearning
#
localllm
Comments
2
 comments
3 min read
[Day 20] Local AI vs cloud AI: one cat photo, 10 video models
PEPPERCORN
PEPPERCORN
PEPPERCORN
Follow
Aug 6
[Day 20] Local AI vs cloud AI: one cat photo, 10 video models
#
localllm
#
ai
#
dgxspark
#
videogeneration
Comments
Add Comment
3 min read
Cloud bills kept climbing from 24/7 AI development — I moved the decisions and the implementation to my own local LLMs and cut the cost
uehara
uehara
uehara
Follow
Aug 15
Cloud bills kept climbing from 24/7 AI development — I moved the decisions and the implementation to my own local LLMs and cut the cost
#
ai
#
llm
#
localllm
#
costoptimization
Comments
Add Comment
10 min read
Running an LLM agent entirely in your browser
Lajos Bencz
Lajos Bencz
Lajos Bencz
Follow
Jul 15
Running an LLM agent entirely in your browser
#
ai
#
localllm
#
webdev
#
machinelearning
Comments
Add Comment
5 min read
local-llm: A Field Report on Running SOTA Models on Your Own Hardware
Reno Lu
Reno Lu
Reno Lu
Follow
Jul 20
local-llm: A Field Report on Running SOTA Models on Your Own Hardware
#
localllm
#
gpu
#
selfhosting
#
inference
1
 reaction
Comments
1
 comment
3 min read
prima.cpp local llm benchmark: 15% Faster Than llama.cpp
Umair Bilal
Umair Bilal
Umair Bilal
Follow
Jun 30
prima.cpp local llm benchmark: 15% Faster Than llama.cpp
#
ai
#
llm
#
localllm
#
benchmarking
Comments
Add Comment
8 min read
Teaching a Local AI Agent to Search the Web (Without Lying to You)
Turgay
Turgay
Turgay
Follow
Aug 1
Teaching a Local AI Agent to Search the Web (Without Lying to You)
#
applesilicon
#
localllm
#
llmagents
#
swift
Comments
Add Comment
24 min read
Why My Local Coding Agent Could Act but Couldn't Finish
Takafumi Endo | ROUTE06
Takafumi Endo | ROUTE06
Takafumi Endo | ROUTE06
Follow
Jul 29
Why My Local Coding Agent Could Act but Couldn't Finish
#
llm
#
localllm
#
qwen
#
agents
1
 reaction
Comments
2
 comments
11 min read
Local AI Agent Browser Extension: Hermes in 120ms
Umair Bilal
Umair Bilal
Umair Bilal
Follow
Jun 24
Local AI Agent Browser Extension: Hermes in 120ms
#
aiagents
#
browserextension
#
localllm
#
hermesagent
Comments
Add Comment
9 min read
Cool AI Projects That Failed: The File Integrity Gap
Jay Grider
Jay Grider
Jay Grider
Follow
Jun 20
Cool AI Projects That Failed: The File Integrity Gap
#
aisecurity
#
localllm
#
softwarebom
#
modelartifacts
Comments
Add Comment
5 min read
Free Local AI Coding Agent: Cut Dev Costs 90%
Umair Bilal
Umair Bilal
Umair Bilal
Follow
Jun 20
Free Local AI Coding Agent: Cut Dev Costs 90%
#
aiagents
#
codingai
#
opensource
#
localllm
Comments
Add Comment
11 min read
My 2-Month local llm daily coding replacement: Real Benchmarks
Umair Bilal
Umair Bilal
Umair Bilal
Follow
Jun 16
My 2-Month local llm daily coding replacement: Real Benchmarks
#
localllm
#
aicoding
#
developerproductivity
#
flutter
Comments
Add Comment
7 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account