DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Performance and Apache Iceberg's Metadata

Performance and Apache Iceberg's Metadata

Comments
7 min read
We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

1
Comments
12 min read
Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database

Stop Using Subqueries: 3 Advanced SQL CTE Patterns That Saved My Production Database

Comments 1
3 min read
Stop Using Spark for Your Small Data - Why Azure Functions is the Right Tool for the Job

Stop Using Spark for Your Small Data - Why Azure Functions is the Right Tool for the Job

Comments
3 min read
Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

1
Comments 1
2 min read
SQL String Functions: Clean, Transform, and Tame Messy Data Like a Pro

SQL String Functions: Clean, Transform, and Tame Messy Data Like a Pro

Comments
6 min read
How to Optimize BigQuery Costs (Real Techniques That Work)

How to Optimize BigQuery Costs (Real Techniques That Work)

1
Comments
9 min read
🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

Comments
5 min read
ETL vs ELT: The Difference That Finally Clicked for Me

ETL vs ELT: The Difference That Finally Clicked for Me

1
Comments
2 min read
What is Dremio? The Unified Lakehouse and AI Platform

What is Dremio? The Unified Lakehouse and AI Platform

Comments
5 min read
Stop Overpaying for AWS Data Transfer: A Guide to VPC Endpoints

Stop Overpaying for AWS Data Transfer: A Guide to VPC Endpoints

Comments
2 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
8 min read
AI Broke Data Engineering Interviews. Nobody Knows What's Next.

AI Broke Data Engineering Interviews. Nobody Knows What's Next.

Comments
7 min read
AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

5
Comments
7 min read
Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.