DEV Community

Ujjwal Dubey
Ujjwal Dubey

Posted on

Read Their Runbooks Before You Hire: A Technical Pass on an Automation Agency

Slide decks lie less when you ask for the runbook they would leave your team.

A practical take on how to choose an AI automation agency by reading runbooks:

What to request under NDA

  • Incident steps when webhooks stop.
  • How they rotate credentials.
  • How they shadow a new version before cutover.
  • How approvals are bound to a payload.

How to score them

score = 0
for section in ["incident", "credentials", "shadow", "approvals", "rollback"]:
    if runbook.has_concrete_steps(section): score += 1
    if runbook.only_slogans(section): score -= 1
Enter fullscreen mode Exit fullscreen mode

A score under three is a soft no, even if the demo sparkles.

Map your own path first with the runbook-first workflow audit sheet. At NxFlowAI the first audit takes 72 hours and the runbook outline is part of the build plan.

NxFlowAI is not affiliated with NexFlow AI or Nexusflow.

Top comments (0)