DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Debezium vs Managed CDC: How to Actually Decide Between Build and Buy
techsourabh profile

Debezium vs Managed CDC: How to Actually Decide Between Build and Buy

#dataengineering #database #cdc
Comments
9 min read
Why do I learn Apache Spark as I move from Data Analyst to Data Engineer?
ashwin_udhayakannan_2 profile

Why do I learn Apache Spark as I move from Data Analyst to Data Engineer?

#spark #dataengineering #ai #career
Comments
2 min read
I Finally Understood AWS Data Pipelines After Following a Single Customer Click
anupa_supul profile

I Finally Understood AWS Data Pipelines After Following a Single Customer Click

#architecture #aws #beginners #dataengineering
Comments
4 min read
Day 65/100 - Implementing Exact-Once Semantics with ClickHouse® and Kafka
kanishga_subramani_49ad73 profile

Day 65/100 - Implementing Exact-Once Semantics with ClickHouse® and Kafka

#clickhouse #devops #database #dataengineering
Comments
6 min read
OKF vs RAG for Data Warehouse Context: Why We Chose a Living Knowledge Base
iblaine profile

OKF vs RAG for Data Warehouse Context: Why We Chose a Living Knowledge Base

#dataengineering #dataquality
Comments
6 min read
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
alexmercedcoder profile

The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough

#architecture #dataengineering #performance #streaming
Comments
22 min read
AI Is Cutting DE Jobs. It's Also Creating Them. Here's the Map.
datadriven profile

AI Is Cutting DE Jobs. It's Also Creating Them. Here's the Map.

#dataengineering #career #python #beginners
Comments
7 min read
PowerBi is smart but also lazy
only_machua_dda6986f7477a profile

PowerBi is smart but also lazy

#data #dataengineering #microsoft #performance
1
Comments
2 min read
What does electricity have to do with knowledge graphs?
coldoven profile

What does electricity have to do with knowledge graphs?

#ai #data #database #dataengineering
Comments
5 min read
Hitting the Iceberg REST Catalog Directly: Understanding the Differences Between Glue Data Catalog and S3 Tables
datapenguin profile

Hitting the Iceberg REST Catalog Directly: Understanding the Differences Between Glue Data Catalog and S3 Tables

#aws #iceberg #dataengineering
7
Comments
17 min read
Why We Built MicroLeague Sports Vol. 2
esolar07 profile
Eddie

Why We Built MicroLeague Sports Vol. 2

#sportstech #web3 #dataengineering #architecture
Comments
7 min read
How to Build Unbroken Candlestick Charts for US Stocks: A Three-Layer Session Tagging Approach
kaihang_ho_2ad23569cdb965 profile
EmilyL

How to Build Unbroken Candlestick Charts for US Stocks: A Three-Layer Session Tagging Approach

#data #dataengineering #fintech #tutorial
1
Comments
2 min read
You saved $80K self-hosting Spark. It cost you $400K.
fagundesv profile

You saved $80K self-hosting Spark. It cost you $400K.

#ai #python #data #dataengineering
Comments
6 min read
Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL
kanishga_subramani_49ad73 profile

Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL

#clickhouse #devops #database #dataengineering
1
Comments
6 min read
The real CDP decision: where should your customer profile live?
gazerro profile

The real CDP decision: where should your customer profile live?

#ai #architecture #data #dataengineering
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.