Skip to content

DEV Community

Edge AI in Practice Series' Articles

Back to GINIGEN AI's Series

Cover image for Running a 180B Model on a Laptop With No GPU: How 4-bit GGUF Keeps Full Accuracy

GINIGEN AI

Oct 6

Running a 180B Model on a Laptop With No GPU: How 4-bit GGUF Keeps Full Accuracy

#ai #llm #edgeai #quantization

6 min read

Cover image for Building an AI That Refuses to Say "Safe": Reliability Engineering for an Offline Disaster App

GINIGEN AI

Oct 6

Building an AI That Refuses to Say "Safe": Reliability Engineering for an Offline Disaster App

#ai #edgeai #llm #android

7 min read

GINIGEN AI

Oct 6

4-bit GGUF Quality for MoE Models: Why Only 3B of 180B Params Fire, and How to Prove Parity

#ai #llm #quantization #edgeai

7 min read