As a data engineer, one of the challenging and sometimes frustrating task is to handle messy information or weird data points passing the pipeline.
Business teams are always firefighting with Data team on accuracy, dashboards not correct or no updated etc.
There are multiple options whether its opensource or closed ones.
Would like to intro with all about decube, not only it helps in managing the data quality or writing tests but also in managing the data catalog which is out of the box option.
It has community edition too (free-forever) with no cap on tables for catalog and lineage.
I strongly suggest to give it a try.
Top comments (0)