DEV Community

#moe

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Running MoE LLMs Larger Than Your RAM: A Practical Guide to mmap, Expert Offloading and SSD Streaming with llama.cpp
eme_gug_0821b41b948be6516 profile

Running MoE LLMs Larger Than Your RAM: A Practical Guide to mmap, Expert Offloading and SSD Streaming with llama.cpp

#llm #llamacpp #moe #performance
Comments
8 min read
An 80GB H100, and only 3B of the model could keep up with conversation
orca_forge profile

An 80GB H100, and only 3B of the model could keep up with conversation

#gpu #llm #moe #ai
Comments
5 min read
The great sparsification: 2026 open-weight MoE models now activate 1 to 9 percent of their weights
ai_maya_063fc568e157562fd profile

The great sparsification: 2026 open-weight MoE models now activate 1 to 9 percent of their weights

#ai #machinelearning #llm #moe
Comments
6 min read
DeepSeek R1: The Open-Source Reasoning Revolution That Changes Everything
ryan_zhao profile

DeepSeek R1: The Open-Source Reasoning Revolution That Changes Everything

#ai #deepseek #moe #reasoning
Comments
2 min read
Your Intel Laptop Can Run 30B Models Now. No NVIDIA. No Cloud. No Problem.
tommy_leonhardsen_81d1f4e profile

Your Intel Laptop Can Run 30B Models Now. No NVIDIA. No Cloud. No Problem.

#llm #openvino #python #moe
Comments
11 min read
How a 176 KB C Binary Runs a 2.78-Trillion-Parameter Model on One CPU with 8 GB of RAM
euk_ela_a3e7ed01aa3f7314e profile

How a 176 KB C Binary Runs a 2.78-Trillion-Parameter Model on One CPU with 8 GB of RAM

#ai #opensource #systems #moe
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.