Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Oct 16

Run GLM-5.3-Flash (321B) locally with Project Maya and EXL3 on one RTX 5090

#ai #localllm #llm #tutorial

10 min read

Oct 16

Run Qwen3.8-Flash-Next at 79 tok/s with Strata and a 5-bit quant on 128 GB of RAM

#ai #localllm #llm #tutorial

11 min read

jamilxt

Oct 13

Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s

#ai #localllm #performance #llm

7 min read

Oct 13

Orquesta CLI: Local LLM Management with Dashboard Sync

#orquestacli #localllm #dashboardsync #ollama

6 min read

Bees

Oct 15

What broke when we ran agents on small local models

#localllm #ai #agents #opensource

6 min read

Alex Fank

Oct 5

Estimating tokens/s for Mixture-of-Experts models: active parameters, plus a routing term

#llm #localllm #machinelearning #performance

5 min read

techaiwire

Oct 7

EmbeddingGemma 2 puts multimodal search on a phone

#google #openweights #localllm #huggingface

4 min read

Reno Lu

Oct 2

Qwen3.8-27B on one RTX 3090, and the setting its README says chat clients should leave at default

#vllm #localllm #speculativedecoding #quantization

4 min read

Sep 29

Still carrying the diagnosis

#localllm #debugging #buildinpublic #opensource

8 min read

DevLog

Sep 28

Claude CLI 401 Unauthorized Refresh Token Issue

#clitools #localllm #troubleshooting

3 min read

DevLog

Sep 27

Discord bot not responding but still running: how to catch it

#automation #localllm #macos

3 min read

KUN Field Notes

Oct 16

Same Local Model, 3 Coding Agents: pi 12/12, Codex 12/12, Claude Code 7/12 on a 6GB GPU

#localllm #llamacpp #ai #claudecode

3 min read

DevLog

Sep 23

Claude Code MCP setup and usage rules

#clitools #macos #localllm

3 min read

DevLog

Sep 23

Clone your own voice with a 17-second recording

#contentops #localllm #macos

2 min read

DevLog

Sep 21

Prompt engineering: How to fix instructions that AI ignores

#promptengineering #ai #localllm

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.