DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Someone Rebuilt Apache Spark from Scratch. I Went to Find Out How.
jakkie_koekemoer profile

Someone Rebuilt Apache Spark from Scratch. I Went to Find Out How.

#dataengineering #distributedsystems #performance #systemdesign
2
Comments 1
5 min read
Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL
kanishga_subramani_49ad73 profile

Day 62: Writing Custom ClickHouse® User-Defined Functions (UDFs) for Cleaner, Reusable SQL

#clickhouse #devops #database #dataengineering
5
Comments
6 min read
Fabric Business Events Just Became an Architecture Pattern
shai_karmani_2521c2f8e837 profile

Fabric Business Events Just Became an Architecture Pattern

#microsoftfabric #realtime #dataengineering #architecture
Comments
7 min read
What Is the Best Bigeye Alternative in 2026?
iblaine profile

What Is the Best Bigeye Alternative in 2026?

#dataengineering #dataquality
Comments
8 min read
Integrated Biological Data Collection Platform: An Architecture for Automated Curation of Public Repositories
jeferson0993 profile

Integrated Biological Data Collection Platform: An Architecture for Automated Curation of Public Repositories

#architecture #automation #dataengineering #science
Comments 1
4 min read
Sync PostgreSQL to MotherDuck with Sling
flarco profile

Sync PostgreSQL to MotherDuck with Sling

#postgres #duckdb #dataengineering #etl
Comments
6 min read
Key Foundational Concepts in Data Engineering
peter_amoro_fccf1d029a084 profile

Key Foundational Concepts in Data Engineering

#beginners #data #dataengineering #tutorial
Comments
5 min read
Why We Open-Sourced 14 Autonomous Data Engineering Agents
dataworkersteam profile

Why We Open-Sourced 14 Autonomous Data Engineering Agents

#dataengineering #ai #opensource #mcp
Comments
5 min read
Building an Incident Debugging Agent: What We've Learned So Far
dataworkersteam profile

Building an Incident Debugging Agent: What We've Learned So Far

#dataengineering #ai #opensource #mcp
Comments
3 min read
Real-Time KPI Dashboards
white_oak_intel profile

Real-Time KPI Dashboards

#analytics #dataengineering #monitoring #systemdesign
Comments
4 min read
Automated Client Reporting
white_oak_intel profile

Automated Client Reporting

#analytics #architecture #automation #dataengineering
Comments
4 min read
I Built a Stream Processing Engine from Scratch in Python — Here's How Windowing Actually Works
hajirufai profile

I Built a Stream Processing Engine from Scratch in Python — Here's How Windowing Actually Works

#python #dataengineering #streaming #tutorial
Comments
4 min read
Rethinking Lakehouse Architecture Through Data Ownership: AWS vs. Snowflake
datapenguin profile

Rethinking Lakehouse Architecture Through Data Ownership: AWS vs. Snowflake

#aws #snowflake #iceberg #dataengineering
5
Comments
9 min read
Redshift Check-In: Spring 2026
elliott_cordo profile

Redshift Check-In: Spring 2026

#aws #cloud #database #dataengineering
2
Comments
4 min read
Why we picked ClickHouse over TimescaleDB (and why it actually matters)
adityabajaj profile

Why we picked ClickHouse over TimescaleDB (and why it actually matters)

#architecture #database #dataengineering #performance
1
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.