DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
From Glue to Horizon: Our Real Journey Building an Iceberg Lakehouse on Snowflake
swaroop_krishna_e2f4b83b2 profile

From Glue to Horizon: Our Real Journey Building an Iceberg Lakehouse on Snowflake

#architecture #aws #dataengineering #snowflake
Comments
10 min read
From Transactions to Insights: How OLTP and OLAP Work Together in Modern Data Pipelines
byrone_code profile

From Transactions to Insights: How OLTP and OLAP Work Together in Modern Data Pipelines

#datascience #datawarehousing #ai #dataengineering
2
Comments
4 min read
Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨
databro profile

Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨

#duckdb #nextjs #dataengineering #database
Comments 1
4 min read
Fraud Detection and Recommendation Are the Same Pipeline. Most Teams Build Two.
vf-insights profile

Fraud Detection and Recommendation Are the Same Pipeline. Most Teams Build Two.

#architecture #dataengineering #machinelearning #systemdesign
Comments
3 min read
PySpark to Pandas/scikit-learn: A Practical Migration Guide for Data Engineers Learning ML
nyson_mark profile

PySpark to Pandas/scikit-learn: A Practical Migration Guide for Data Engineers Learning ML

#dataengineering #datascience #machinelearning #python
Comments
7 min read
FINAL in ClickHouse Isn’t as Expensive as It Used to Be
mohhddhassan profile

FINAL in ClickHouse Isn’t as Expensive as It Used to Be

#clickhouse #dataengineering #databaseopimization #replacingmergetree
3
Comments
4 min read
🚀 DB Explorer 3.0.1 — The AI‑First SQL Editor You’ll Want to Try
ashish_srivastava_e6b8ecc profile

🚀 DB Explorer 3.0.1 — The AI‑First SQL Editor You’ll Want to Try

#sql #database #postgres #dataengineering
Comments
1 min read
My first data pipeline
mushroomsandchai profile

My first data pipeline

#showdev #beginners #dataengineering #sideprojects
Comments
1 min read
ETL vs ELT: Which One Should You Use and Why?
john_analytics profile

ETL vs ELT: Which One Should You Use and Why?

#architecture #beginners #data #dataengineering
1
Comments
6 min read
ETL vs ELT: Which One Should You Use and Why?
samwel_sam profile

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #etl #elt #luxdev
1
Comments
4 min read
A Beginner’s Guide to Apache Kafka: The Engine of Real-Time Data
lawrence_murithi profile

A Beginner’s Guide to Apache Kafka: The Engine of Real-Time Data

#kafka #dataengineering #luxdev
2
Comments
11 min read
Extract Transform Load vs Extract Load Transform (ETL vs ELT)
michaelmwai profile

Extract Transform Load vs Extract Load Transform (ETL vs ELT)

#architecture #beginners #data #dataengineering
Comments
5 min read
Entity Resolution at Scale: Matching Products Across Amazon, Reddit, and RTINGS
danie_rozin profile

Entity Resolution at Scale: Matching Products Across Amazon, Reddit, and RTINGS

#ai #webdev #dataengineering #tutorial
Comments
4 min read
Apache Data Lakehouse Weekly: April 3–9, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: April 3–9, 2026

#news #data #dataengineering #opensource
Comments
7 min read
Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026
datastackx profile

Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026

#dataengineering #python #airflow #dagster
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.