DEV Community

Christopher Maher profile picture

Christopher Maher

Husband, dad, and software engineering leader. Passionate about automation, AI, emerging tech, and ham radio (N7CPM).

Joined Joined on  github website
LLMKube Now Deploys Any Inference Engine, Not Just llama.cpp
defilan profile

LLMKube Now Deploys Any Inference Engine, Not Just llama.cpp

#llm #opensource #ai #kubernetes
Comments
3 min read
I tested speculative decoding on my home GPU cluster. Here's why it didn't help.
defilan profile

I tested speculative decoding on my home GPU cluster. Here's why it didn't help.

#llm #kubernetes #gpu #ai
Comments
5 min read
Google Released Gemma 4 Yesterday. I Had It Fixing Real Bugs by Lunch.
defilan profile

Google Released Gemma 4 Yesterday. I Had It Fixing Real Bugs by Lunch.

#kubernetes #llm #homelab #ai
1
Comments
5 min read
I Tested TurboQuant KV Cache Compression on Consumer GPUs. Here's What Actually Happened.
defilan profile

I Tested TurboQuant KV Cache Compression on Consumer GPUs. Here's What Actually Happened.

#llm #kubernetes #gpu #ai
1
Comments
6 min read
The $0 Problem: Why Every Tool Says Your On-Prem Inference is Free
defilan profile

The $0 Problem: Why Every Tool Says Your On-Prem Inference is Free

#finops #ai #kubernetes #opensource
Comments
4 min read
llama.cpp on Kubernetes: The Guide I Wish Existed
defilan profile

llama.cpp on Kubernetes: The Guide I Wish Existed

#kubernetes #ai #opensource #devops
1
Comments
9 min read
loading...