hwmonitor directly inspects Linux /sys and /proc kernel interfaces to extract hardware specifications without subprocess overhead from utilities like lspci, dmidecode, or lshw. It supports ANSI terminal formatting, structured JSON output, and AI-driven telemetry diagnostics powered by the Groq API.
hwmonitor --gpu -A "Can I run a 70B model locally on this hardware?"
--- AI Hardware Analysis (Groq) ---
With 8GB VRAM on your RTX 5060 a 70B model won't fit even with
INT4 quantization. You'd need ~35GB VRAM. Stick to 7B-13B models,
or offload layers to your 32GB RAM at the cost of ~4x slower
inference.
You ask your hardware a question. It answers. From the terminal.
CPU, GPU, RAM, Storage, Mainboard, Battery — all discovered, all JSON-serializable.
hwmonitor: https://github.com/th0truth/hwmonitor
What hardware questions would you ask?
Top comments (0)