DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
From Raw DNA to Deep Insights: Building a Personal Genomics RAG with LangChain and PubMed

From Raw DNA to Deep Insights: Building a Personal Genomics RAG with LangChain and PubMed

Comments
4 min read
The Missing Primitive in Modern Data Architecture: Relationship Discovery

The Missing Primitive in Modern Data Architecture: Relationship Discovery

Comments 1
2 min read
Data-driven decision making using Power BI.

Data-driven decision making using Power BI.

Comments 2
3 min read
S3 Triggers: How to Launch Glue Python Shell via AWS Lambda

S3 Triggers: How to Launch Glue Python Shell via AWS Lambda

4
Comments
8 min read
When Factor Libraries Meet Real-World Execution Constraints

When Factor Libraries Meet Real-World Execution Constraints

Comments
2 min read
Apache Airflow for Production: Essential Concepts Every Developer Should Know

Apache Airflow for Production: Essential Concepts Every Developer Should Know

Comments
16 min read
How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures

How I Redesigned a Failing Data Pipeline to Eliminate Cascading Failures

Comments
9 min read
Build a Local Lead Gen Machine: Scraping Google Maps with n8n (Reliably)

Build a Local Lead Gen Machine: Scraping Google Maps with n8n (Reliably)

Comments
3 min read
Apache Data Lakehouse Weekly: December 30, 2025 – January 5, 2026

Apache Data Lakehouse Weekly: December 30, 2025 – January 5, 2026

Comments
4 min read
Building a Government Tender Intelligence System with Python: Lessons from the Real World

Building a Government Tender Intelligence System with Python: Lessons from the Real World

Comments
4 min read
Why Data Integration Still Feels Manual (And What We’re Missing)

Why Data Integration Still Feels Manual (And What We’re Missing)

Comments 1
3 min read
Data Engineering: The Backbone of Structured Data

Data Engineering: The Backbone of Structured Data

6
Comments
3 min read
Stop Writing Regex for Data You Should Be Describing in English

Stop Writing Regex for Data You Should Be Describing in English

3
Comments
4 min read
Stop Writing Regex for Data You Should Be Describing in English

Stop Writing Regex for Data You Should Be Describing in English

5
Comments
4 min read
Building a Modern Data Platform — Dagster - Dbt - Iceberg

Building a Modern Data Platform — Dagster - Dbt - Iceberg

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.