DEV Community

Cover image for dcvpg β€” Data Contract Validator & Pipeline Guardian πŸ›‘οΈ
Pasindu Dilshan
Pasindu Dilshan

Posted on

dcvpg β€” Data Contract Validator & Pipeline Guardian πŸ›‘οΈ

I just open sourced something I wish existed when I started building data pipelines.

Meet dcvpg β€” Data Contract Validator & Pipeline Guardian πŸ›‘οΈ

The problem: data teams spend hours debugging issues that could have been caught at the gate.
Schema changed. Freshness SLA missed. Null values slipped through. Nobody noticed until downstream.

dcvpg lets you define data contracts as code and enforces them automatically:

βœ… Schema drift detection β€” catch column drops, type changes before they hit prod
βœ… Quality rule validation β€” nullability, regex, range checks, custom rules
βœ… Freshness SLA monitoring β€” alert when your pipeline goes stale
βœ… Pipeline gate integration β€” block bad data at the source

Built for data engineers who are tired of being the last to know when something breaks.

100% open source. Python. YAML-based contracts. CI/CD friendly.

πŸ‘‰ github.com/pasindudilshan1/dcvpg
https://pasindudilshan1.github.io/dcvpg/

Drop a ⭐ if this solves a problem you've lived.

DataEngineering #OpenSource #DataContracts #PipelineQuality #Python #DataQuality

Top comments (0)