DEV Community

#mixtureofexperts

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Extending llama.cpp to Support Reflection Beam-1.0-501B-A23B: Handling Complex MoE and Attention Architectures
pdrojack profile

Extending llama.cpp to Support Reflection Beam-1.0-501B-A23B: Handling Complex MoE and Attention Architectures

#llamacpp #mixtureofexperts #attention #modelconversion
Comments
3 min read
Addestrare un mini-LLM da 25M parametri su CPU: anatomia di un GLM “flash” e cosa imparare davvero
frontendfacile profile

Addestrare un mini-LLM da 25M parametri su CPU: anatomia di un GLM “flash” e cosa imparare davvero

#llmsucpu #attenzionesparsa #attenzionelineare #mixtureofexperts
Comments
5 min read
Checking a Cost Model Against a Stranger's Config File
megapixel99 profile

Checking a Cost Model Against a Stranger's Config File

#llm #measurement #mixtureofexperts
1
Comments
5 min read
Qwen3.8-Flash-Next vs Qwen3.8-27B: 125B Parameters, 6B Active — What the Qwen4 Preview Changes
shaam_ai profile

Qwen3.8-Flash-Next vs Qwen3.8-27B: 125B Parameters, 6B Active — What the Qwen4 Preview Changes

#qwen #openweightllm #mixtureofexperts #aiagents
Comments
6 min read
Kimi K3: A New Benchmark for Open-Weights Mixture-of-Experts
pneumetron profile

Kimi K3: A New Benchmark for Open-Weights Mixture-of-Experts

#ai #machinelearning #mixtureofexperts #kimik3
Comments
3 min read
Running a 26B MoE on an 8 GB Jetson by streaming experts from SSD
anyesh profile

Running a 26B MoE on an 8 GB Jetson by streaming experts from SSD

#moestream #llamacpp #mixtureofexperts #jetsonorin
Comments 1
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.