OpsBuddy: A Privacy-First Local AI SysAdmin Mentor (Built with Gemma, Ollama & Sentry)

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend

What I Built

I built OpsBuddy, a local, privacy-first AI mentor designed specifically for SysAdmin and Linux training in a CLI environment.

I built this for my friend and trainee, Andre, who is currently learning the ropes of server administration. The biggest hurdle for beginners like him is understanding complex error logs without accidentally leaking sensitive server information (like IPs, usernames, or paths) to public cloud AI tools. OpsBuddy solves this by running entirely locally on his machine. It acts as a safe, intelligent sandbox where he can ask technical questions and securely analyze local .log files.

Demo

Here is OpsBuddy in action safely analyzing a local log file, along with the deep-dive performance tracing data captured by Sentry!

Code

xdendix / opsbuddy

View on GitHub

How I Built It

OpsBuddy is built around a fully open-source and local stack:

• AI Model: Google's Gemma 2B (open-weight model) for fast, concise, and accurate technical mentoring.
• Local Inference: Ollama to run the LLM efficiently without internet access.
• Logic & UI: Python combined with the rich library for a beautiful, colorful CLI experience.
• Agent Tracing: Sentry SDK to monitor the AI's performance. I implemented start_transaction and start_child spans to track the exact latency of the local inference streaming process whenever Andre interacts with the agent, ensuring the application remains responsive.

Why Does Open Innovation Matter?

Open innovation is the absolute backbone of this project. By utilizing open-weight models like Gemma 2B and open local harnesses like Ollama, OpsBuddy guarantees absolute data privacy. Andre can command the AI to analyze sensitive SSH, database, or application logs without the fear of that data being sent to a closed, third-party API. Open innovation made it possible to build a capable, free-to-use mentor that respects user data sovereignty.

Prize Categories

• Best Use of Gemma
• Best Use of Sentry Agent Tracing

Comments

[Amn Tree]

Really cool idea! I like this approach. :)

I actually experimented with something similar a while ago and even built a small MVP around local LLMs. The idea was to monitor server logs in real time, let the AI analyze what's happening, detect potential issues, and suggest possible fixes.

Basically, an AI sysadmin assistant that keeps an eye on the infrastructure and helps figure out what the hell is going wrong before things get messy. :)

I think there's a lot of potential in this direction, especially when everything runs locally and sensitive data stays on your own machine.

Great concept, respect for actually building it and sharing it. Keep it up! Good job!

[Dendi Prayogo Hidayat]

When I created this app, the first thing that came to mind was privacy how to build a system that’s helpful yet secure and can run on a local network.
It seems there are plenty of similar apps out there that are cooler and better than this one like yours.

Thanks, friend. Keep up the great work.