DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Data Mesh vs. Data Fabric: The Future of Data Management

Data Mesh vs. Data Fabric: The Future of Data Management

1
Comments
6 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB

Reading CSVs with varying column counts that pandas cannot read using DuckDB

Comments
3 min read
SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

Comments
11 min read
Unable to emit metadata to DataHub GMS with Airflow - a solution

Unable to emit metadata to DataHub GMS with Airflow - a solution

Comments
4 min read
Running the "Quickstart for dbt and Snowflake" Tutorial with dbt Projects on Snowflake

Running the "Quickstart for dbt and Snowflake" Tutorial with dbt Projects on Snowflake

Comments
14 min read
Engineering with SOLID, DRY, KISS, YAGNI and GRASP

Engineering with SOLID, DRY, KISS, YAGNI and GRASP

1
Comments
16 min read
15 foundational concepts on Data Engineering

15 foundational concepts on Data Engineering

Comments
6 min read
Stop Writing Nested Loops for ETL. Compile Them with convtools

Stop Writing Nested Loops for ETL. Compile Them with convtools

Comments
6 min read
Which is Best for Real Time Dashboards: Airbyte, Fivetran, or Estuary Flow

Which is Best for Real Time Dashboards: Airbyte, Fivetran, or Estuary Flow

1
Comments
7 min read
Truth About Data Engineering Myths in 2025

Truth About Data Engineering Myths in 2025

Comments
5 min read
A Recap of Data Engineering Concepts

A Recap of Data Engineering Concepts

Comments
6 min read
Direct Oracle Fusion to Power BI — A Zero-Extract Method

Direct Oracle Fusion to Power BI — A Zero-Extract Method

Comments
1 min read
Decoding Data Engineering: 15 Core Concepts That Power Modern Data Platforms

Decoding Data Engineering: 15 Core Concepts That Power Modern Data Platforms

Comments
4 min read
Rust DataFrame Alternatives to Polars: Meet Elusion v4.0.0

Rust DataFrame Alternatives to Polars: Meet Elusion v4.0.0

Comments
5 min read
15 Data Engineering Core Concepts Simplified

15 Data Engineering Core Concepts Simplified

Comments
6 min read
I’m Not Chasing a Job — I’m Building Myself

I’m Not Chasing a Job — I’m Building Myself

Comments
2 min read
Data Platform for Analyzing Kenya’s Food Prices and Inflation Trends.

Data Platform for Analyzing Kenya’s Food Prices and Inflation Trends.

Comments
5 min read
Docker Persistence: When and How to Keep Your Container Data

Docker Persistence: When and How to Keep Your Container Data

Comments
2 min read
Introduction to REST Catalogs for Apache Iceberg

Introduction to REST Catalogs for Apache Iceberg

1
Comments
8 min read
Building A Universal Data Agent in 15 Minutes with LlamaIndex and Apache Gravitino (incubating)

Building A Universal Data Agent in 15 Minutes with LlamaIndex and Apache Gravitino (incubating)

1
Comments
9 min read
Capture Slowly Changing Attributes in SQL - SCD Type 2

Capture Slowly Changing Attributes in SQL - SCD Type 2

Comments
8 min read
15 Core Data Engineering Concepts Every Developer Should Know

15 Core Data Engineering Concepts Every Developer Should Know

Comments
6 min read
AI-Powered Data Engineering Pipelines: Smarter, Faster, Scalable

AI-Powered Data Engineering Pipelines: Smarter, Faster, Scalable

Comments
2 min read
Testando com Monkey Patching

Testando com Monkey Patching

Comments
4 min read
Data Engineering vs Data Science: Why the Debate Still Misses the Point

Data Engineering vs Data Science: Why the Debate Still Misses the Point

Comments
2 min read
loading...