Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Patricio Navarro for Google Developer Experts

Mar 31

Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

#serverless #dataengineering #cloud #tutorial

5 min read

Max Klein

Mar 2

Data Pipeline Architecture: From Messy CSVs to Clean Database

#python #dataengineering #tutorial #database

5 min read

Aki for AWS Community Builders

Apr 4

Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector

#aws #snowflake #dataengineering

6 min read

Abubakar

Apr 4

Epistemic Control Systems: Anchoring on Kafka

#architecture #dataengineering #distributedsystems #systemdesign

4 min read

Blessing Angus

Feb 28

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

#dataengineering #zohodeskapi #bigquery #elt

7 min read

Beck_Moulton

Mar 1

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

#machinelearning #python #dataengineering #healthtech

3 min read

Niccolò Colombini

Apr 3

Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

#automation #dataengineering #productivity #python

3 min read

Aaron Wiegel

Mar 4

Synthetic Data and the Privacy Problem: Beyond Alice and Bob

#dataengineering #testing

10 min read

Philip Hern

Apr 3

how i use cursor and ai agents to write dbt tests and documentation

#dbt #cursor #ai #dataengineering

2 min read

Byron Hsieh

Mar 4

dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters

#dbt #openlineage #dataengineering #python

7 min read

Alberto Cardenas

Mar 1

PardoX 0.3.1: The GPU Awakening and the Conquest of the Universal Backend

#showdev #backend #dataengineering #performance

19 min read

Erika S. Adkins

Feb 28

Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML

#webscraping #python #node #dataengineering

5 min read

Philip Hern

Apr 3

the future of data engineering workflows with ai

#dataengineering #ai #workflow #future

2 min read

Hannah Usmedynska

Apr 3

100 Spark Scenario Based Interview Questions and Answers

#career #data #dataengineering #interview

24 min read

Kunwar Jhamat

Mar 4

ETL Pipeline: The 6-Phase Pattern That Cuts Debugging From Hours to Minutes

#etl #dataengineering #programming #architecture

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

Data Pipeline Architecture: From Messy CSVs to Clean Database

Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector

Epistemic Control Systems: Anchoring on Kafka

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

Synthetic Data and the Privacy Problem: Beyond Alice and Bob

how i use cursor and ai agents to write dbt tests and documentation

dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters

PardoX 0.3.1: The GPU Awakening and the Conquest of the Universal Backend

Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML

the future of data engineering workflows with ai

100 Spark Scenario Based Interview Questions and Answers

ETL Pipeline: The 6-Phase Pattern That Cuts Debugging From Hours to Minutes