DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

3
Comments
5 min read
The Web Scraping Data Warehouse Pipeline I Run for $12/Month

The Web Scraping Data Warehouse Pipeline I Run for $12/Month

Comments
3 min read
CSV: The Format Nobody Designed

CSV: The Format Nobody Designed

Comments
2 min read
Stop Babysitting Servers: Build a Scalable Serverless Data Lake on AWS

Stop Babysitting Servers: Build a Scalable Serverless Data Lake on AWS

Comments
2 min read
Are ClickHouse JOINs Slow? A 2026 PR-by-PR Analysis

Are ClickHouse JOINs Slow? A 2026 PR-by-PR Analysis

5
Comments
18 min read
CTEs vs Subqueries in SQL: Which One Should You Use?

CTEs vs Subqueries in SQL: Which One Should You Use?

Comments
3 min read
Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

1
Comments 1
2 min read
Apache Airflow 2 vs 3: A Deep Technical Comparison for Data Engineers

Apache Airflow 2 vs 3: A Deep Technical Comparison for Data Engineers

1
Comments
15 min read
🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

Comments
5 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
8 min read
AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

5
Comments
7 min read
Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Comments
3 min read
How to Install Github Desktop for Data Analysis Projects

How to Install Github Desktop for Data Analysis Projects

Comments
2 min read
Your Ruby CSV Import Ran Successfully — Your Data May Still Be Wrong

Your Ruby CSV Import Ran Successfully — Your Data May Still Be Wrong

1
Comments
2 min read
Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Cross-Cloud Pipeline with ADF & STS: Architecture, Troubleshooting & Costs

Comments
17 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.