DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Apache Data Lakehouse Weekly: March 16 – April 2, 2026

Apache Data Lakehouse Weekly: March 16 – April 2, 2026

1
Comments
7 min read
Scaling Time-Series Data: Partitioning, Replication and Backup in Apache IoTDB

Scaling Time-Series Data: Partitioning, Replication and Backup in Apache IoTDB

Comments
6 min read
From Dirty CSV to Golden Records: A Python Walkthrough

From Dirty CSV to Golden Records: A Python Walkthrough

Comments
10 min read
Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

Securely Implementing Snowflake AWS Lambda Integration with Key Pair Authentication + Secrets Manager

3
Comments
5 min read
Using Databricks Genie for Natural Language Querying on Semantic Models

Using Databricks Genie for Natural Language Querying on Semantic Models

Comments
7 min read
The Web Scraping Data Warehouse Pipeline I Run for $12/Month

The Web Scraping Data Warehouse Pipeline I Run for $12/Month

Comments
3 min read
CSV: The Format Nobody Designed

CSV: The Format Nobody Designed

Comments
2 min read
CTEs vs Subqueries in SQL: Which One Should You Use?

CTEs vs Subqueries in SQL: Which One Should You Use?

Comments
3 min read
Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

Augmented Analytics: AI-Assisted Data Insights and the Future of Intelligent Decision-Making

1
Comments 1
2 min read
🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

🌐 Beyond One Data Source: Building Scalable Data Pipelines in Power BI

Comments
5 min read
Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Understanding Data Modeling in Power BI: Joins, Relationships, and Schemas Explained

Comments
8 min read
AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

AWS Snowflake Lakehouse: 2 Practical Apache Iceberg Integration Patterns

5
Comments
7 min read
Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Backfilling Is Harder Than Scraping: Lessons From Rebuilding 6 Months of Missing Data

Comments
3 min read
Designing Stable Integration Testing Architectures for Data-Driven Systems By QA Transformation & Integration Architect

Designing Stable Integration Testing Architectures for Data-Driven Systems By QA Transformation & Integration Architect

Comments
3 min read
How to Install Github Desktop for Data Analysis Projects

How to Install Github Desktop for Data Analysis Projects

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.