DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How Pandas Simplifies ETL Data Cleaning

How Pandas Simplifies ETL Data Cleaning

Comments
6 min read
Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Comments
5 min read
Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Comments
6 min read
Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Comments
1 min read
Number Non-Null Values in Order within the Group — From SQL to SPL #17

Number Non-Null Values in Order within the Group — From SQL to SPL #17

6
Comments 1
2 min read
🚿 Data Cleaning in Python, 2025 Edition

🚿 Data Cleaning in Python, 2025 Edition

Comments
1 min read
Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

3
Comments
3 min read
Data Engineering Concepts: A project based introduction

Data Engineering Concepts: A project based introduction

3
Comments
11 min read
Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

5
Comments 5
3 min read
Getting Started with Simple Data Integrator (SDI):Scheduler Settings

Getting Started with Simple Data Integrator (SDI):Scheduler Settings

Comments
2 min read
Getting Started with Simple Data Integrator (SDI): Data Mapping Example (Oracle to SQL Server)

Getting Started with Simple Data Integrator (SDI): Data Mapping Example (Oracle to SQL Server)

Comments
3 min read
Simple Data Integrator (SDI): Seamless Data Integration in Just 3 Steps

Simple Data Integrator (SDI): Seamless Data Integration in Just 3 Steps

Comments
2 min read
Getting Started with Simple Data Integrator (SDI): Direct Connection Setup

Getting Started with Simple Data Integrator (SDI): Direct Connection Setup

Comments
2 min read
Transforming Rows to Columns and Back: SQL PIVOT/UNPIVOT Techniques

Transforming Rows to Columns and Back: SQL PIVOT/UNPIVOT Techniques

1
Comments
2 min read
Materialized Views in SQL: Supercharging Read Performance

Materialized Views in SQL: Supercharging Read Performance

Comments
2 min read
The evolution of Data Engineering and the role of ELT tools

The evolution of Data Engineering and the role of ELT tools

Comments
8 min read
Simple Data Integrator (SDI) – The Lightweight Yet Powerful ETL Tool for All Your Data Integration Needs

Simple Data Integrator (SDI) – The Lightweight Yet Powerful ETL Tool for All Your Data Integration Needs

Comments
2 min read
dbt for Normies - A Complete Guide.

dbt for Normies - A Complete Guide.

1
Comments 3
7 min read
From Chaos To Clarity: Making Your Data AI Ready

From Chaos To Clarity: Making Your Data AI Ready

Comments 1
4 min read
🚀Lakehouses Demystified: The Future of Data is Here!

🚀Lakehouses Demystified: The Future of Data is Here!

1
Comments 1
3 min read
Recursion in SQL: Unlocking Trees and Graphs with Recursive CTEs

Recursion in SQL: Unlocking Trees and Graphs with Recursive CTEs

Comments
3 min read
◼️1/100 Block-by-Block: Learning Resources

◼️1/100 Block-by-Block: Learning Resources

Comments 3
1 min read
A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)

A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)

Comments 2
8 min read
Mastering SQL Window Functions: ROW_NUMBER vs RANK vs DENSE_RANK

Mastering SQL Window Functions: ROW_NUMBER vs RANK vs DENSE_RANK

Comments
2 min read
Mastering SQL Joins: Your Definitive Guide to Relational Data Mastery

Mastering SQL Joins: Your Definitive Guide to Relational Data Mastery

Comments
2 min read
loading...