DEV Community

Cover image for PostgreSQL change data capture governed Apache Iceberg / Parquet on AWS S3 — built for AI agents.
Burnside Project
Burnside Project

Posted on

PostgreSQL change data capture governed Apache Iceberg / Parquet on AWS S3 — built for AI agents.

Core Features

pg-cdc is not just replication. pg-cdc streams Postgres Write Ahead Logs(WAL) out of production Postgres into typed, immutable,
time-travelable Iceberg tables on S3

Registers each entities in the AWS Glue Catalog
Gates every read with AWS Lake Formation tags — so AI agents, analysts, and query engines consume governed data without ever touching the source database, and without database credentials.
No JVM. One binary.

No return path — the WAL is one-way; Parquet is immutable. Agents physically cannot write to production.
No database credentials — consumers authenticate via AWS IAM + Lake Formation, never a connection string.

Governed by default — untagged data is invisible; Lake Formation tags gate every read, down to the column.

Time travel built in — every flush is an Iceberg snapshot; CDC epochs + immutable raw@ tags give historical queries with no database branching.

Book a Meeting

GitHub Repo

Top comments (0)