Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
ollama
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
The 4GB Card Isn't the Bottleneck: 84% of a DDR4 Channel Is
Jax Sinclair
Jax Sinclair
Jax Sinclair
Follow
Nov 19
The 4GB Card Isn't the Bottleneck: 84% of a DDR4 Channel Is
#
llm
#
ollama
#
gguf
#
performance
1
reaction
Comments
Add Comment
7 min read
Moderation
Living in the Terminal with your LLM
Shahriar Haque Abir
Shahriar Haque Abir
Shahriar Haque Abir
Follow
Nov 19
Living in the Terminal with your LLM
#
powershell
#
llm
#
ollama
Comments
Add Comment
11 min read
Moderation
vLLM vs Ollama: which should you use to serve an LLM?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 19
vLLM vs Ollama: which should you use to serve an LLM?
#
llm
#
vllm
#
ollama
#
ai
Comments
Add Comment
10 min read
Moderation
I turned 2,654 gallery photos into 512 notes with local AI (silver prize in a prompt contest)
JustJinoIT
JustJinoIT
JustJinoIT
Follow
Nov 18
I turned 2,654 gallery photos into 512 notes with local AI (silver prize in a prompt contest)
#
ai
#
ollama
#
privacy
#
productivity
Comments
Add Comment
3 min read
Moderation
갤러리 사진 2,654장을 노트 512개로 만든 프롬프트 (SKT 프롬프트 공모전 은상)
JustJinoIT
JustJinoIT
JustJinoIT
Follow
Nov 18
갤러리 사진 2,654장을 노트 512개로 만든 프롬프트 (SKT 프롬프트 공모전 은상)
#
ai
#
ollama
#
privacy
#
productivity
Comments
Add Comment
1 min read
Moderation
Como rodar Ollama e Open WebUI numa VPS (IA privada, sem GPU)
Nuvem Dev
Nuvem Dev
Nuvem Dev
Follow
Nov 18
Como rodar Ollama e Open WebUI numa VPS (IA privada, sem GPU)
#
ollama
#
selfhosted
#
ai
#
docker
Comments
Add Comment
2 min read
Moderation
Re-Ranking the Top 20 With Local Models: Only the 12B Fixed the Miss, and It Demoted Two Right Answers
Nerav Doshi
Nerav Doshi
Nerav Doshi
Follow
Nov 18
Re-Ranking the Top 20 With Local Models: Only the 12B Fixed the Miss, and It Demoted Two Right Answers
#
ollama
#
rag
#
reranking
#
evaluation
Comments
Add Comment
4 min read
Moderation
Swept the Per-Article Cap From 1 to 3: The Gains Run Out Before the Costs Do
Nerav Doshi
Nerav Doshi
Nerav Doshi
Follow
Nov 18
Swept the Per-Article Cap From 1 to 3: The Gains Run Out Before the Costs Do
#
ollama
#
rag
#
embeddings
#
chromadb
Comments
Add Comment
4 min read
Moderation
Faire tourner un MoE de 35B sur une GTX 1650 4 Go : le test réel
Nabil Doghri
Nabil Doghri
Nabil Doghri
Follow
Nov 17
Faire tourner un MoE de 35B sur une GTX 1650 4 Go : le test réel
#
ai
#
llm
#
ollama
#
localai
Comments
Add Comment
7 min read
Moderation
Ollama Runs Your Model. Who's Running Everything Else?
Luis M
Luis M
Luis M
Follow
Nov 17
Ollama Runs Your Model. Who's Running Everything Else?
#
ai
#
ollama
#
rag
#
selfhosted
Comments
Add Comment
4 min read
Moderation
Why is my local model slow? mtop 1.6 tries to tell you
EladSer
EladSer
EladSer
Follow
Nov 17
Why is my local model slow? mtop 1.6 tries to tell you
#
llm
#
ollama
#
opensource
#
go
Comments
Add Comment
2 min read
Moderation
Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
DudeSquad999 · Building Prism AI
Follow
Nov 16
Benchmarking Local LLMs for LaTeX and Code Generation on Windows: What Actually Works
#
ai
#
localllm
#
ollama
#
windows
Comments
Add Comment
2 min read
Moderation
Local Inference: Running Models on Your Own Machine
Internals Decoded
Internals Decoded
Internals Decoded
Follow
Nov 16
Local Inference: Running Models on Your Own Machine
#
ai
#
localllm
#
ollama
#
llamacpp
Comments
Add Comment
13 min read
Moderation
Ollama Tutorial: Run Your First Local LLM in Python
The Practical Developer
The Practical Developer
The Practical Developer
Follow
Nov 16
Ollama Tutorial: Run Your First Local LLM in Python
#
ollama
#
llm
#
python
#
ai
Comments
Add Comment
7 min read
Moderation
Run AI on Your Own Laptop: Free, Private and Offline with Ollama
Muiduzzaman Lipu
Muiduzzaman Lipu
Muiduzzaman Lipu
Follow
for
Refactorly
Nov 15
Run AI on Your Own Laptop: Free, Private and Offline with Ollama
#
ai
#
llm
#
ollama
#
beginners
Comments
Add Comment
3 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account