DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Iceberg Table Optimization #7: Using Iceberg Metadata Tables to Determine When Compaction Is Needed
alexmercedcoder profile

Apache Iceberg Table Optimization #7: Using Iceberg Metadata Tables to Determine When Compaction Is Needed

#database #datascience #dataengineering #apacheiceberg
1
Comments
3 min read
Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables
alexmercedcoder profile

Apache Iceberg Table Optimization #4: Smarter Data Layout — Sorting and Clustering Iceberg Tables

#database #datascience #dataengineering #apacheiceberg
2
Comments
3 min read
Database Design Errors to Avoid & How To Fix Them
roxana_haidiner profile

Database Design Errors to Avoid & How To Fix Them

#database #sql #mysql #dataengineering
11
Comments 1
5 min read
Cross-Platform Multi-Channel Attribution in Marketing: Balancing Costs and Results Across Devices
andrey_s profile

Cross-Platform Multi-Channel Attribution in Marketing: Balancing Costs and Results Across Devices

#analytics #marketing #attribution #dataengineering
1
Comments
5 min read
2025 Data Warehouse Benchmark: What BigQuery, Snowflake, and Others Don’t Tell You
techsourabh profile

2025 Data Warehouse Benchmark: What BigQuery, Snowflake, and Others Don’t Tell You

#dataengineering #cloud #datawarehouse #benchmarking
3
Comments
2 min read
đź›’ Real-Life Data Lakehouse Use Case: Revolutionizing Retail Analytics
qvfagundes profile

đź›’ Real-Life Data Lakehouse Use Case: Revolutionizing Retail Analytics

#datascience #dataengineering #data #ai
2
Comments
2 min read
A Real-Time Earthquake Monitoring Pipeline with Kafka, MySQL, PostgreSQL, and Grafana
dkkinyua profile

A Real-Time Earthquake Monitoring Pipeline with Kafka, MySQL, PostgreSQL, and Grafana

#python #dataengineering #data
3
Comments
4 min read
Why Your Data Fails You - and How a Data Platform Can Fix It
andrey_s profile

Why Your Data Fails You - and How a Data Platform Can Fix It

#cloudstorage #dataengineering #datagovernance #cloudcomputing
1
Comments
4 min read
Cloud Data Tools Simplified: AWS, Google Cloud, and Azure
andrey_s profile

Cloud Data Tools Simplified: AWS, Google Cloud, and Azure

#cloudstorage #dataengineering #datagovernance #cloudcomputing
1
Comments
7 min read
Stop Drawing ETL Diagrams — Your Python Code Visualizes Itself
edwardvaneechoud profile

Stop Drawing ETL Diagrams — Your Python Code Visualizes Itself

#python #dataengineering #opensource #programming
4
Comments
4 min read
⚡ Kafka ClickHouse: Real-Time Data Pipeline for Beginners
mohhddhassan profile

⚡ Kafka ClickHouse: Real-Time Data Pipeline for Beginners

#dataengineering #kafka #clickhouse #docker
4
Comments
2 min read
Become the Serverless DJ. How to process audio using AWS?
jakubstanislawczyk profile

Become the Serverless DJ. How to process audio using AWS?

#aws #node #programming #dataengineering
2
Comments
8 min read
Why Data Formats Matter More Than You Think
andrey_s profile

Why Data Formats Matter More Than You Think

#dataengineering #datastructures #dataformats #apacheparquet
1
Comments
19 min read
How to Document SQL Server Schemas Visually in 2025
roxana_haidiner profile

How to Document SQL Server Schemas Visually in 2025

#sqlserver #sql #database #dataengineering
12
Comments 1
4 min read
Interesting links - May 2025
rmoff profile

Interesting links - May 2025

#data #dataengineering #kafka #flink
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.