DEV Community

weiwuji
weiwuji

Posted on

From Documents to Mechanisms: Onboarding Checklist, Checkpoint Gates, and Rollback

The Pain: Your methodology is materialized. Rules layer, facts layer, pipeline layer, memory layer - the files all exist. Then you hit a new problem: the files are written, but does anyone actually read them? You drop the docs into the shared drive, and three days later you ask the new hire "did you read it?" He says yes. Then he submits work that contradicts the rules in the documents. You check the read logs - the file was opened 3 times, 2 minutes each. Can anyone read a 200-page SOP in 2 minutes?
What You'll Learn:

  • Why "documents written" is not "documents used" - the three gaps that kill every SOP
  • The landing trio: onboarding checklist, checkpoint gates, and a rollback mechanism
  • How each piece maps to a real artifact you can build and verify on your own machine today
  • Why this trio beats "more training" - and how it makes trust scalable

Opening: 200 pages of SOP, and the new hire still cannot do the job

In the previous article - From One-Person Methodology to Team Assets: The 4-Step Materialization Framework - we turned the methodology into four layers: Rule Layer, Fact Layer, Pipeline Layer, Memory Layer. The files are all written: STANDING.md, value practice cards, four physical gates, error-ledger. Then you discover a new problem: the files are written, but will the team actually read them?

Real scenario: you put the documents into the shared drive. Three days later you ask the new hire "did you read it?" He says yes. Then he submits output that contradicts every rule in the documents. You open the read log - opened 3 times, 2 minutes each. Can a 200-page SOP be read in 2 minutes?

Between "documents written" and "documents used" lies an entire mechanism. Most organizational SOPs die in the same place: the file lies in the shared drive, and nobody ever finishes reading it. Today's cure is the landing trio: onboarding checklist, checkpoint gates, rollback mechanism - turning "did you read it" from a verbal promise into a machine-verifiable gate. These three are not invented for this article; they are components running on my own system, and every command can be reproduced on your machine.


Why "documents written" is not "documents used" - the three gaps

Documents go unused not because people are lazy, but because of three gaps:

Gap What it looks like Root cause
No path The new hire does not know which file to read first "What to learn" is guesswork
No verification Nobody can confirm whether it was read "Did you learn it" relies on asking
No safety net The new hire is afraid to touch anything, scared of breaking it "Cost of trying" is unknown

So SOP rollout is not about more training. It is about filling three holes: the checklist gives the path, the checkpoint gives verification, the rollback gives safety. Let's open each one.

The SOP landing trio: old way (200-page SOP opened 3 times for 2 minutes) transforms into checklist, checkpoint gate, and rollback - new hire productive in one week


Step 1: The onboarding checklist - turn "what to learn" into "tasks that must be checked off"

Problem: a document is not a task. Anything without a deadline and an acceptance criterion sits at the bottom of every to-do list forever. The new hire is not unwilling to learn; he simply does not know where to start.

Solution: an onboarding checklist. Every item is "checkable + produces an artifact + verifiable". This is the checklist running in my own system (/root/shared/onboarding-checklist.md), first three days:

## Day 1: read the rules
- [ ] Read STANDING.md end to end, write out any one rule verbatim
      (acceptance: cat /root/shared/STANDING.md | head -30)
- [ ] Read .hermes.md, restate the publish path
      (acceptance: can state that the legacy publish CLI is banned,
       publishing goes through baoyu-post-to-wechat)
## Day 2: run the pipeline
- [ ] Run the 4 gates on article-23.md, screenshot the output
      (acceptance: validate_article.py check returns 100/100)
- [ ] Read 2 value practice cards, restate the "pitfall and fix" fields
## Day 3: produce independently
- [ ] Walk through the full publish flow, confirm the draft appears
      (acceptance: draft/batchget returns the title and content is not truncated)
Enter fullscreen mode Exit fullscreen mode

The key design is the acceptance command: the artifact of every task must be verifiable by one command, not by "I feel like I learned it". Every item on the checklist eventually flows into a real file. Our task board (/root/shared/writer-task-board.md) is a living handover list - one agent writes TODO items, another picks them up and updates the status; tasks move through the file, not through anyone's memory. Account handover uses the same mechanism: the handoff guide ships in two waves (four domestic platforms first, three overseas platforms second), and every item states exactly what needs to be provided.

โœ… Verification: once the new hire checks off the list, asking "did you read it" is pointless - the artifacts are sitting there, open the file and check.

๐Ÿฉธ Pitfall: the worst checklist is a "reading list" - "recommended reading: XXX". That is not a checklist, that is a bibliography. A bibliography has no acceptance criteria, cannot be checked off, and becomes the second file gathering dust in the shared drive.

๐Ÿ’ผ Direct value: the first step of a one-week handover is not "learning fast", it is "path clarity". On day one the new hire knows what to read first, what to produce, and how to verify it.

โ–ธ Cognitive shift: a checklist is essentially turning "what to learn" from an individual judgment into the team's default path - once the path is written down, it no longer depends on who is doing the mentoring.


Step 2: The checkpoint gate - turn "did you read it" into "is the evidence there"

Problem: a checked box can still be a lie. "I read it" is an attitude, and attitudes cannot be verified. You ask the new hire "do you understand?" He says yes. Do you believe him or not?

Solution: the checkpoint does not verify attitude, it verifies evidence. The first comment in our gate script says: never read the LLM's self-report, only read real file evidence. That comment was earned by walking into the pitfall - early on we relied on the agent reporting "done", and its self-reports frequently disagreed with actual state; once we switched to file evidence only, false reports died automatically.

The real artifact is gate-check.sh (under /root/hermes-harness/scripts/hooks/). It does not check "did you read STANDING.md"; it checks "is the artifact that STANDING injection produces present" and "is the task-context file created". Evidence missing โ†’ blocked; blocked 3 times โ†’ escalated to a human. Zero subjective judgment anywhere in the loop.

The same logic runs harder in the content pipeline: 4 physical gates, and any gate failure means sys.exit(1) - the publish command never executes:

python3 /root/hermes-harness/scripts/validate_article.py check article-23.md
python3 /root/hermes-harness/scripts/check_series_continuity.py check
python3 /root/hermes-harness/scripts/article_checker.py article-23.md
python3 /root/hermes-harness/gate/publish_gate.py article-23.md
Enter fullscreen mode Exit fullscreen mode

Real output (I ran the first gate on this very article on my machine):

check: article-24.md | PASS
body: 3666 chars
quality score: 100/100 (16/16 checks passed)
ALL CHECKS PASSED - article meets the publish standard
Enter fullscreen mode Exit fullscreen mode

โœ… Verification: any output only counts as qualified after passing every gate - it does not matter how senior you are or who you are; only evidence matters.

๐Ÿฉธ Pitfall: checkpoints must check "evidence", never "reports". We actually walked into this: the agent self-reported "validation done" while the artifact was missing fields; only the gate scan caught it. Human review has the same flaw - you catch things when you are in a good state and miss them when you are not, so the gate has to be physically enforced.

๐Ÿ’ผ Direct value: quality moves from "I trust you" to "I verify you". The new hire does not need to prove himself; he only needs to produce evidence.

โ–ธ Cognitive shift: a checkpoint is essentially turning "trust" from a judgment about a person into a check on evidence - trust becomes scalable because it no longer depends on character.

The checkpoint gate flow: new hire submits output -> does evidence exist? yes -> next step; no -> blocked, retry, 3 blocks in a row -> escalate to human


Step 3: The rollback mechanism - the confidence that lets new hires dare to try

Problem: the checklist gives the path, the checkpoint gives verification, but the new hire still does not dare to touch anything - afraid of breaking it. In an organization without rollback, new hires do not dare to change things; if they do not dare to change, they cannot learn; if they cannot learn, the founder still carries everything alone.

Solution: rollback = change is reversible. Three concrete actions:

1. Version control: commit before you change, so you can go back if you break it. Our knowledge base (/root/weiwuji-knowledge-base) makes every change a commit:

git log --oneline -5
# fa0676f deep-read notes from 5 WeChat articles
# 11888df complete deep-analysis report v1.0
Enter fullscreen mode Exit fullscreen mode

Broke something? git revert brings you back to the last stable version in seconds.

2. Publishing can be re-uploaded: a wrong draft is not a disaster - just re-upload it. The real artifact is reorder_drafts.py, which re-uploads drafts in reading order; the ledger (publication-ledger.md) verifies the draft box on every check (draft/batchget), and when a draft is missing from the box it is marked "confirm needed" and waits for human confirmation - never silently overwritten.

3. Errors can be logged: every rollback is a piece of knowledge. error-ledger.md logs in four parts: symptom โ†’ root cause โ†’ fix โ†’ status. A real entry:

## 2026-08-02 ยท Daily report trend date shows "?" (fallback fix for missing collected_at)
**Symptom:** trend date in the daily report shows a question mark
**Root cause:** collected_at field missing
**Fix:** add date fallback logic - when collected_at is missing, fall back to the entry-level timestamp
**Status:** fixed
Enter fullscreen mode Exit fullscreen mode

โœ… Verification: git revert is one command; after logging an error, grep finds the answer in 10 seconds.

๐Ÿฉธ Pitfall: rollback fails when it is "built but never used". We paid for this: the overseas duplicate-publish incident happened precisely because nobody had recorded "Draft not found actually means the publish succeeded", and the retry logic created duplicates. Now every error is logged the same day it happens.

๐Ÿ’ผ Direct value: rollback compresses the cost of trying from hours to minutes. New hires dare to practice on the real system - and the more they practice, the faster they learn.

โ–ธ Cognitive shift: rollback is essentially turning "I broke it" from an incident into a learnable experiment - experiments are allowed to fail, as long as every failure is recorded.

The rollback loop: change ships -> checkpoint fails -> revert to last stable -> log to error ledger -> fix and retry; every rollback produces one error record


Before vs After: one-week handover vs three months of mentoring

Stage Before: writing documents After: the landing trio
Learning path The new hire digs through the shared drive, guessing Checklist items checked off one by one, path explicit
Did they learn it Ask "do you understand?", he says yes Gate verifies evidence, artifacts speak
Something broke Wait for the founder to rescue, system stalls git revert / re-upload, recovery in minutes
Trial mindset Afraid, does not dare to touch Dares - mistakes can be rolled back and learned from
While you are on vacation The new hire calls you Checklist + gates + rollback run by themselves

Why the trio beats "more training"

A lot of people assume SOP rollout equals running a few more training sessions. Wrong direction again.

Training solves "do you know it"; the trio solves "can you, and do you dare". The checklist turns "what to learn" into executable tasks, the checkpoint turns "did you learn it" into verifiable evidence, and rollback turns "trial and error" into a low-cost action - together, they form a learning environment that allows failure.

Go one layer deeper: an organization can give trust to newcomers in two ways. One is betting on character - "I bet you will read it carefully". The other is betting on mechanism - "whether you read it or not, the evidence will speak". Mechanism-based trust does not need a bet, so it scales: a new hire arrives, copy a checklist, run the same gates, enjoy the same rollback net.

This is the second real question of digital transformation: the carrier of organizational capability evolves from "documents" to "mechanisms". In the previous article we turned experience into documents; in this one we turn documents into mechanisms. Documents go stale; mechanisms self-correct - because every rollback flows back through the error ledger into a new rule.


Summary: 3 things you can start today

  1. Write an onboarding checklist: break your system's "what to learn" into 3 days of checkable tasks, each with one acceptance command
  2. Change "did you read it" to "is the evidence there": give your key documents a check script, and block when evidence is missing
  3. Build one rollback action: put the system under git (or equivalent version control) first, then create an error ledger - log today's pitfall today

Do these three, and your documents get "used" for the first time. This is the second foundation stone of digital transformation - first make the documents get used, then talk about upgrading the organization.

Next article: Digital Transformation in Practice, Part 3 - From SOP to Immunity: Turning Every Incident into Organizational Capability

The trio lets a new hire take over in one week, but incidents will still come. Next we upgrade the error ledger from "personal debugging" to "organizational immunity": incident โ†’ log โ†’ fix โ†’ feed back into the rules, so the system grows a memory every time it makes a mistake - this is what Loop Engineering looks like at the organizational level.


๐Ÿงญ Cognitive Index

๐Ÿท๏ธ Entities: onboarding-checklist ยท gate-check.sh ยท error-ledger ยท reorder_drafts.py
๐Ÿ’ผ Value: SOP rollout ยท one-week handover ยท organizational mechanisms
๐Ÿง  Cognition: from "writing good documents" to "making documents get used"

About the author: Wu Ji (ๆ— ่ฎฐ) โ€” AI / Agent / digital transformation practitioner. Only writes things that actually ran end to end, no concepts for their own sake. Follow along and it just works.

Top comments (0)