DEV Community

Cover image for ๐Ÿฆ† Effortless Data Quality w/duckdb on GitHub โ™พ๏ธ
adriens for opt-nc

Posted on

3

๐Ÿฆ† Effortless Data Quality w/duckdb on GitHub โ™พ๏ธ

๐Ÿช Teaser (for the impatients)

Do you have a repository that relies on csv files... and want to operate:

  • ๐Ÿ›ก๏ธ Protect your data with quality intergrity checks before to corrupt your data
  • ๐Ÿ”ฌ Check data quality as part of your project lifecycle
  • ๐Ÿ“Š Get operational KPIs reporting
  • โ™พ๏ธ Automate release process to explain your contributors what has been achieved
  • ๐Ÿ“ฆ Deliver data
  • ๐Ÿคฏ Endless usages

๐Ÿซต Don't look further, this sort post will cover all these aspects with a practical and highly understandable workflow.

๐Ÿฟ Demo

Enough talks, let's jump'in:

๐Ÿฆ†๐Ÿ’ป๐Ÿ”๐Ÿ”งโ™พ๏ธ๐Ÿฆ† opt-nc/setup-duckdb-action

GitHub logo opt-nc / setup-duckdb-action

๐Ÿฆ† Blazing Fast and highly customizable Github Action to setup a DuckDb runtime

semantic-release ๐Ÿ›ก๏ธ CodeQL ๐Ÿš€ Release

โ„น๏ธ Setup Duckdb Action

This action installs duckdb with the version provided in input.

๐Ÿ“œ Inputs

version

Not Required The version you want to install. If no version defined, the latest version will be installed.

๐Ÿš€ Example usage

uses: opt-nc/setup-duckdb-action@v1.0.8
with:
  version: v1.0.0
Enter fullscreen mode Exit fullscreen mode
uses: opt-nc/setup-duckdb-action@v1.0.8
Enter fullscreen mode Exit fullscreen mode

๐Ÿ“‘ Related resources




๐Ÿ”ญ Further ๐ŸŽ€

Once CI (Continuous Integration) has been done... you can also think (without a lot of efforts) to Deliver that data to third party services, as part of your DEVOPS pipeline.

A this point I see two easy options:

... which make your data available for new usecases, at no additional effort:

Sentry image

Hands-on debugging session: instrument, monitor, and fix

Join Lazar for a hands-on session where youโ€™ll build it, break it, debug it, and fix it. Youโ€™ll set up Sentry, track errors, use Session Replay and Tracing, and leverage some good olโ€™ AI to find and fix issues fast.

RSVP here โ†’

Top comments (7)

Collapse
 
adriens profile image
adriens โ€ข

Collapse
 
adriens profile image
adriens โ€ข

Collapse
 
adriens profile image
adriens โ€ข

Collapse
 
adriens profile image
adriens โ€ข

A very cool place to watch:

Collapse
 
adriens profile image
adriens โ€ข

Collapse
 
adriens profile image
adriens โ€ข
Collapse
 
adriens profile image
adriens โ€ข

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

๐Ÿ‘‹ Kindness is contagious

Please leave a โค๏ธ or a friendly comment on this post if you found it helpful!

Okay