Replays compare versions after the fact. Shadow mode compares them while traffic is live, without writing to the CRM or sending a message.
When we act as a custom AI workflow agency that ships behind a shadow switch, the new path logs what it would have done. The old path still acts. You only cut over when the logs match on the decisions you care about.
Minimal pattern
def handle(event, old_flow, new_flow, shadow=True):
proposed = new_flow(event)
if shadow:
log_shadow(event["id"], proposed)
return old_flow(event)
return proposed
Compare route, needs_approval and crm_stage for a few days. Ignore wording diffs. Fail the shadow period if the new path would have auto-sent where the old path waited for a person.
Cutover checklist
- Turn shadow off for a small segment first.
- Keep a kill switch that reverts to the old path in one click.
- Keep the same approval owners during the first week.
For how we score page and copy quality before automation, see the vibe-checker methodology. At NxFlowAI the first audit takes 72 hours and usually includes a shadow window in the build plan.
NxFlowAI is not affiliated with NexFlow AI or Nexusflow.
Top comments (0)