DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Tableau Sales Dashboard Performance (Updated for 2025)
vamshi_e_eebe5a6287a27142 profile

Tableau Sales Dashboard Performance (Updated for 2025)

#datascience #dataengineering
1
Comments
4 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
andrey_s profile

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

#datamanagement #dataengineering #database #bigdata
1
Comments
6 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena
datapenguin profile

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

#aws #iceberg #dataengineering
2
Comments
4 min read
🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management
qvfagundes profile

🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management

#dataengineering #datawarehouse #snowflake
Comments
1 min read
What Is Change Data Capture (CDC) and How It Works on Google Cloud
_richardson_ profile

What Is Change Data Capture (CDC) and How It Works on Google Cloud

#gcp #bigquery #dataengineering #database
Comments
2 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB
nk_maker profile

Reading CSVs with varying column counts that pandas cannot read using DuckDB

#dataengineering #duckdb #csv #programming
1
Comments
3 min read
Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas
amolo_hillary profile

Working with Apache to automate collection of Weather data for Kenya’s major Agricultural Areas

#dataengineering #dataanalytics #apacheairflow #luxdev
Comments
5 min read
Building a Data Career: The Skills That Truly Matter
datalane profile

Building a Data Career: The Skills That Truly Matter

#datascience #dataengineering #career #sql
10
Comments
5 min read
You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
andrey_s profile

You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees

#dataengineering #dataquality #datamonitoring #sql
2
Comments 1
8 min read
Unable to emit metadata to DataHub GMS with Airflow - a solution
ivicak profile

Unable to emit metadata to DataHub GMS with Airflow - a solution

#airflow #dataengineering #datahub #data
Comments
4 min read
Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege
qvfagundes profile

Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

#dataengineering #dataprivacy #datawarehouse #snowflake
Comments
1 min read
Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

#aws #iceberg #dataengineering #duckdb
5
Comments 1
7 min read
PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods
datapenguin profile

PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods

#aws #iceberg #dataengineering
2
Comments
3 min read
Three Formats Walk into a Lakehouse: Iceberg, Delta and Hudi in a Local Setup You Can Run on Your Laptop
olgabraginskaya profile

Three Formats Walk into a Lakehouse: Iceberg, Delta and Hudi in a Local Setup You Can Run on Your Laptop

#dataengineering #data #tutorial #learning
10
Comments 4
16 min read
The Rise of Real-Time Data: Why Batch Might Be Fading
milcah03 profile

The Rise of Real-Time Data: Why Batch Might Be Fading

#ai #kafka #airflow #dataengineering
10
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.