DEV Community

Scarab Systems
Scarab Systems

Posted on

Full Observer Deck Console Landed: Testing Long-Horizon AI Implementation Against Repo Truth

That sentence means something specific.

Not “an AI generated a dashboard.”

Not “Codex wrote a lot of code.”

Not “a mockup became a pretty screen.”

What landed is a real second-pass implementation of Scarab’s Observer layer: a validator-gated, SDS-guided operator console built across multiple routed workbench surfaces, with source code, backend read models, tests, screenshots, runtime validation, checkpoint documentation, and documented carry-forward gaps.

This is the strongest Scarab continuous implementation test so far.

The question

The question was not whether Codex can write code.

It can.

The question was whether an AI coding agent can sustain long-horizon implementation inside a real repo without drifting, if the repo continuously surfaces the truth it needs to build against.

That is the experiment.

For this run, Codex wrote the code.

Scarab supplied the implementation guidance.

That distinction matters.

Scarab was not telling Codex exactly what code to write. It was continuously providing repo-specific guidance: current repo truth, ownership surfaces, boundaries, contracts, validators, current gaps, and the next lawful implementation step.

That is the layer I wanted to test.

Can the agent keep implementing when the repo itself keeps telling it what is true?

Why Observer matters

The target was Scarab’s own Observer layer.

Observer is the internal operator console I need to see Scarab while I am putting it through its paces.

It surfaces diagnostics, telemetry, workspaces, evidence, runtime state, gates, policy posture, PR readiness, contracts, schemas, search, and implementation visibility.

This is not a toy app.

This is a complex multi-stack console.

The Observer stack includes Next.js, React, TypeScript, shadcn UI, Tailwind, Radix UI, TanStack Query, TanStack Table, Zustand, React Flow, Monaco, ECharts, Playwright, pnpm, Node.js, Python, RabbitMQ, Celery, JSON Schema, Docker, Docker Compose, and supporting UI/runtime libraries.

The work had to span frontend, backend read models, runtime visibility, test contracts, route workbenches, state surfaces, screenshot proof, and read-only diagnostic posture.

That is exactly the kind of long-horizon implementation where AI agents usually begin to drift.

What landed

Observer Gold Pass 2 landed as a completed implementation pass, ready for my audit and likely a third visual-polish pass.

That posture matters.

I am not claiming “finished forever.”

The correct claim is:

Observer Gold Pass 2 landed as a serious second-pass implementation across the Observer workbench surface.

The Observer Deck now has a real routed/operator-console structure across the major surfaces:

Overview

Run Command Center

Workflow Graph

Gate Timeline

Evidence and Artifacts

Worker Plane

Vaults and Source Docs

Target Workspace / Patch Lab

GitHub PR Console

Observability / Telemetry

Run Comparison

Contracts and Schemas

Settings / Runtime Profiles

Search

The final review captured screenshots for all 14 workbench modes from the rebuilt Observer runtime.

That means this was not just planned UI.

The routes exist, render, and were captured as runtime evidence.

The implementation surface

Pass 2 landed the shared shell foundation: dark/dense operator deck styling, route/workbench navigation, global read-only object inspector, persistent event dock, stable operator posture, and the left-rail route/mode structure.

The backend/read-model capacity also expanded.

The code and docs show read-model surfaces for worker/queue visibility, source-doc and vault readiness, workspace patch/test/diff/retained-evidence/cleanup surfaces, policy/PR/no-leakage/schema/supply-chain posture, observability/telemetry, runtime profiles, and cross-route search correlation.

Panel-level work landed across the major domains.

Overview became a command-center surface with KPI/status grammar, owner health, active run attention, subsystem trends, artifact/telemetry previews, and route shortcuts.

Workflow became a graph/timeline workbench with React Flow surfaces, command controls, selected object inspector, blocked path/provenance, and gate timeline work.

Queues became a Worker Plane with queue health, worker/task inventory, stale/retry/dead-letter posture, event context, and read-only inspection.

Runs became a run command center and comparison surface with run rail, active progress, stage/evidence/blocker detail, event controls, A/B comparison, failures/logs/traces where emitted, and honest missing-state handling.

Evidence became an artifact/source-vault workbench with artifact command center, filters, read-only inspector, preview/provenance tabs, lineage, source docs, and vault readiness.

Workspaces became a target workspace / patch lab surface with workspace status, patch iterations, test matrix, retained evidence, diff/activity/cleanup posture, and runtime profile visibility.

Policy became a policy/supply-chain/PR/contracts surface with public safety posture, GitHub PR readiness, no-leakage/human gates, contracts/schemas registry, and supply-chain correlation.

Observability/Telemetry landed as read-only operator visibility over metrics, traces, logs/events, service/pipeline posture, and existing observability stack boundaries.

Search landed as a final cross-correlation layer across runs, gates, queues, workers, tasks, artifacts, source docs, workspaces, patches, policy, PRs, schemas, telemetry, blockers, and evidence.

How the work was completed

This was not one giant “make dashboard” run.

It was executed as a staged, validator-gated implementation campaign.

The roadmap structure was:

Stage 1: shared shell, navigation, inspector, event dock

Stage 2: read-model capacity

Stage 3: Overview

Stage 4: Workflow Graph and Gate Timeline

Stage 5: Queues / Worker Plane

Stage 6: Runs and Run Comparison

Stage 7: Evidence, Artifacts, Vaults, Source Docs

Stage 8: Workspaces, Patch Lab, Runtime Profiles

Stage 9: Policy, GitHub PR, Contracts, Supply Chain

Stage 10: Observability / Telemetry

Stage 11: Search final correlation

Stage 12: Final Gold Review

Each stage/slice was documented with checkpoint files.

The uploaded evidence package contains 51 second-pass checkpoint markdown files, plus planning documents and screenshot proof.

That is a real work trail.

The process was consistent with the SDS continuous implementation mode I have been developing:

Scarab supplied implementation guidance and boundaries.

Codex wrote the code.

Each slice was planned.

Fail-first tests were used where practical.

Backend/read-model changes were paired with frontend types and UI behavior.

Screenshots were captured as visual proof.

Missing or unavailable signals were labeled honestly as not_emitted, rather than faked.

Observer remained read-only.

Mutation controls were avoided or explicitly disabled/human-gated.

Final completion was not claimed until validation and runtime proof were captured.

That is the difference between code generation and governed implementation.

How it was tested

The final Stage 12 checkpoint recorded these validation results:

Backend Observer / Four-Plane contracts: 47 passed in 3.95s

Console typecheck: pnpm typecheck passed

Console production build: pnpm build passed

Full Observer browser suite: 169 passed in 2.3 minutes

Observer runtime image rebuild passed

Observer runtime recreate passed

Runtime health endpoint returned status: ok

Docker health reported the Observer container as healthy

14 final runtime screenshots were captured as non-empty PNGs

The source itself also shows substantial test coverage.

In the uploaded observer/console/tests directory, the tests cover shell behavior, navigation, Overview, Workflow, Workspaces, Policy, Evidence, Runs, Queues, Observability, Search, accessibility, and runtime boundaries.

observer-deck.spec.ts alone is about 3,441 lines with 141 test cases.

observer-polish.spec.ts is about 535 lines with 28 test cases.

There are also focused accessibility and runtime-boundary tests.

The Observer Python files also compiled cleanly in an independent compile check: 23 Python files compiled successfully.

That matters because this is not only a frontend shell.

The backend/read-model side exists in Python files such as queues.py, workspaces.py, policy.py, observability.py, source_docs.py, runtime_profiles.py, workflows.py, artifacts.py, and runs.py.

Why this is real work

This is real work for five reasons.

First, the implementation exists as actual source code.

Excluding build artifacts, dependencies, .next, out, test-results, and cache files, the Observer upload contains about 202 source/config files and roughly 42k lines of implementation/config/test code.

That does not include the dependency lockfile.

This is not a one-file prototype.

Second, the frontend is decomposed into real feature areas: overview, workflows, queues, runs, evidence, workspaces, policy, telemetry, search, events, runtime profiles, layout, fixtures, types, contracts, UI primitives, and tests.

Third, the backend/read-model side exists.

Observer is not only a static React shell.

Fourth, the documentation trail is extensive and structured.

The docs include roadmaps, slice plans, checkpoint summaries, screenshot directories, and final review proof.

It looks like a real engineering pass, not after-the-fact storytelling.

Fifth, the final checkpoint is honest about carry-forward gaps.

It does not pretend the Observer is perfect.

It records that the global header refresh-pill/layout jump still needs a later shell/runtime pass, that trace/log rows remain honest not_emitted until approved observability query paths exist, and that a third visual-polish pass is recommended.

That honesty is part of the proof.

A system that calls itself done too early is not governed implementation.

It is just confidence with a UI.

What this proves in the Scarab thread

This is the third major proof direction in the Scarab work.

The first was narrow patching.

Given repo truth, rules, ownership, boundaries, and validators, an AI coding agent can make narrow bug patches without drifting across unrelated repo surfaces.

The second was stepwise quieting.

Given a noisy repo surface, Scarab can run a loop: find the hotspot, identify the boundary, make the bounded repair, rerun, and step down toward quiet.

The Observer build tests the next layer:

long-horizon AI implementation.

Not one patch.

Not one repair.

Not one quick feature.

A sustained implementation campaign across a real repo and a complex stack.

The important point is not volume.

Anyone can make an agent generate code volume.

The important point is behavior.

Can the agent keep going without losing the thread?

Can it preserve contracts?

Can it avoid fake data?

Can it label missing signals honestly?

Can it checkpoint stages?

Can it capture proof?

Can it refuse to call incomplete work done?

That is what this build tested.

The conclusion

Observer Gold Pass 2 landed.

The correct claim is not:

“Observer is finished forever.”

The correct claim is:

Observer Gold Pass 2 landed as a real, validator-gated, SDS-guided implementation pass across the Observer workbench surface, with source code, tests, read models, screenshots, runtime validation, and documented carry-forward gaps.

And the stronger product proof is:

Codex wrote the code, but the run was kept aligned by Scarab’s repo-specific implementation guidance, ownership/boundary structure, validator gates, checkpointing, and refusal to call incomplete work done.

That is real governed implementation work.

This is the layer I have been trying to build toward.

Not AI code generation.

Not vibe coding.

Not “give the model a bigger prompt.”

Repo truth surfaced continuously enough that an AI coding agent can keep implementing without drifting away from the system it is supposed to serve.

That is the experiment.

Observer landed.

And it landed as real work.

Top comments (0)