As software engineers, we’re constantly juggling code reviews, PR descriptions and feedback. Recently I’ve been testing GitHub Models (public preview) — a new feature that lets you prototype, evaluate and use LLMs directly inside your GitHub repositories.
One experiment: automatically summarising every Pull Request using a prompt stored as code (.prompt.yml) and a GitHub Action. The Action calls the chosen model (GPT-4o, Claude, Mistral, etc.) and posts a concise summary right back into the PR as a comment.
Why it’s exciting:
• Prompts & parameters are version-controlled alongside code
• Side-by-side model comparisons to balance cost vs. quality
• Easy to prototype in the Playground, then integrate in CI/CD
This small automation is already making reviews faster and more focused.
Curious to see what else we can build when AI becomes a first-class citizen in our repos.
Have you tried GitHub Models yet? How are you using it?
Top comments (0)