DEV Community

Cover image for 💰LLM Cost Control for DevOps Open Agent 💰
Prashant Lakhera
Prashant Lakhera

Posted on

💰LLM Cost Control for DevOps Open Agent 💰

As more teams bring LLMs into their DevOps workflows, one question keeps coming up:

How do we keep AI costs under control?

This week, we shipped two more enterprise-ready features in DevOps Open Agent to make AI-assisted troubleshooting more transparent and cost-aware.

1️⃣ Usage Budget Alerts

📌 You can already track token usage across investigations.

📌 Now you can also set a daily budget (for example, $20/day).

📌 Once the estimated spend crosses your configured threshold, DevOps Open Agent sends a single alert per day via Slack or Microsoft Teams, helping you catch unexpected costs.

2️⃣ Editable Pricing Table

LLM pricing changes frequently, and every organization negotiates different rates.

Instead of relying on hardcoded values, you can now:

📌 Update model pricing directly from the Usage → Pricing page

📌 Or edit the pricing_table.json file manually

The pricing configuration is stored on your persistent data volume, so your custom rates remain intact even after upgrades or restarts.

🎯 Our goal is simple:

Build an open-source, self-hostable AI platform that enables DevOps and Platform Engineering teams to adopt GenAI with full visibility into usage, cost, and operations without sacrificing control.

⭐ GitHub: https://github.com/ideaweaver-ai/devops-open-agent

🎥 Video: https://lnkd.in/ghzJjMWe

Top comments (0)