DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Scalable Data Architecture with Apache Tools: A Free and Open-Source Solution

Building a Scalable Data Architecture with Apache Tools: A Free and Open-Source Solution

Comments
3 min read
Python 101:The Ultimate Beginner’s Guide

Python 101:The Ultimate Beginner’s Guide

1
Comments
4 min read
Common Mistakes to Avoid in Data Engineering Job Interviews (And How to Nail Them)

Common Mistakes to Avoid in Data Engineering Job Interviews (And How to Nail Them)

Comments
3 min read
Is Big Data Dying?

Is Big Data Dying?

1
Comments
7 min read
How Pandas Simplifies ETL Data Cleaning

How Pandas Simplifies ETL Data Cleaning

Comments
6 min read
Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Git Branching and Merging: A Data Engineer's Guide to Efficient Code Management

Comments
5 min read
Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Detailed Logic for RDF Conversion and Use in RDH (Robust Data Hub)

Comments
6 min read
Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Stop Using CSVs in Big Data: Here's Why You Should Learn Apache Iceberg

Comments
1 min read
Number Non-Null Values in Order within the Group — From SQL to SPL #17

Number Non-Null Values in Order within the Group — From SQL to SPL #17

6
Comments 1
2 min read
🚿 Data Cleaning in Python, 2025 Edition

🚿 Data Cleaning in Python, 2025 Edition

Comments
1 min read
Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

Step-by-Step: Create & Load Data into a Lakehouse in Microsoft Fabric

3
Comments
3 min read
Data Engineering Concepts: A project based introduction

Data Engineering Concepts: A project based introduction

3
Comments
11 min read
Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

Building an Automated Crypto Price ETL Pipeline with Airflow and PostgreSQL

5
Comments 5
3 min read
Getting Started with Simple Data Integrator (SDI):Scheduler Settings

Getting Started with Simple Data Integrator (SDI):Scheduler Settings

Comments
2 min read
Getting Started with Simple Data Integrator (SDI): Data Mapping Example (Oracle to SQL Server)

Getting Started with Simple Data Integrator (SDI): Data Mapping Example (Oracle to SQL Server)

Comments
3 min read
Simple Data Integrator (SDI): Seamless Data Integration in Just 3 Steps

Simple Data Integrator (SDI): Seamless Data Integration in Just 3 Steps

Comments
2 min read
Getting Started with Simple Data Integrator (SDI): Direct Connection Setup

Getting Started with Simple Data Integrator (SDI): Direct Connection Setup

Comments
2 min read
Transforming Rows to Columns and Back: SQL PIVOT/UNPIVOT Techniques

Transforming Rows to Columns and Back: SQL PIVOT/UNPIVOT Techniques

1
Comments
2 min read
Materialized Views in SQL: Supercharging Read Performance

Materialized Views in SQL: Supercharging Read Performance

Comments
2 min read
The evolution of Data Engineering and the role of ELT tools

The evolution of Data Engineering and the role of ELT tools

Comments
8 min read
Simple Data Integrator (SDI) – The Lightweight Yet Powerful ETL Tool for All Your Data Integration Needs

Simple Data Integrator (SDI) – The Lightweight Yet Powerful ETL Tool for All Your Data Integration Needs

Comments
2 min read
From Chaos To Clarity: Making Your Data AI Ready

From Chaos To Clarity: Making Your Data AI Ready

Comments 1
4 min read
dbt for Normies - A Complete Guide.

dbt for Normies - A Complete Guide.

1
Comments 1
7 min read
🚀Lakehouses Demystified: The Future of Data is Here!

🚀Lakehouses Demystified: The Future of Data is Here!

1
Comments 1
3 min read
Recursion in SQL: Unlocking Trees and Graphs with Recursive CTEs

Recursion in SQL: Unlocking Trees and Graphs with Recursive CTEs

Comments
3 min read
loading...