DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Delta Lakes: ACID Transactions, Time Travel & Delta Tables
qvfagundes profile

Delta Lakes: ACID Transactions, Time Travel & Delta Tables

#dataengineering #databricks #ai #datascience
Comments
6 min read
Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings
ahmeddeelhassancode profile

Top 5 Data Engineering Tools for 2026: Why Python and SQL remain Kings

#webdev #python #sql #dataengineering
Comments
2 min read
How I Built a Scalable Data Engineering Blog with Next.js & Supabase
ahmeddeelhassancode profile

How I Built a Scalable Data Engineering Blog with Next.js & Supabase

#nextjs #supabase #webdev #dataengineering
Comments
1 min read
Automating ETL Workflows with Apache Airflow: From Python Script to Scheduled Pipeline
petermuriya profile

Automating ETL Workflows with Apache Airflow: From Python Script to Scheduled Pipeline

#dataengineering #airflow #python #programming
1
Comments
3 min read
Trial by Fire: From Garbage Excel to Relational Graph with Python and Pandas
dalaez profile

Trial by Fire: From Garbage Excel to Relational Graph with Python and Pandas

#data #dataengineering #datascience #python
Comments
4 min read
Beating 250,000 Mental Comparisons: A Cross-Domain Engineer's Entity Resolution Case Study
_d3709cf9e80fc6babbff profile

Beating 250,000 Mental Comparisons: A Cross-Domain Engineer's Entity Resolution Case Study

#dataengineering #architecture #ai #productivity
1
Comments
10 min read
The Journey from Scattered Data to an Apache Iceberg Lakehouse with Governed Agentic Analytics
alexmercedcoder profile

The Journey from Scattered Data to an Apache Iceberg Lakehouse with Governed Agentic Analytics

#agents #analytics #architecture #dataengineering
Comments
6 min read
Bringing Sexy Back to Data Engineering: Automating BigQuery and Looker Sync
funsize_engineer profile

Bringing Sexy Back to Data Engineering: Automating BigQuery and Looker Sync

#automation #dataengineering #gemini #googlecloud
2
Comments 1
3 min read
Aprendiendo Recurrent Neural Networks (Parte 2): Dándole "memoria" a nuestra red y logrando un MAE de 10.05
galp76 profile

Aprendiendo Recurrent Neural Networks (Parte 2): Dándole "memoria" a nuestra red y logrando un MAE de 10.05

#machinelearning #python #deeplearning #dataengineering
Comments
6 min read
The Backyard Quarry, Part 8: From Rocks to Reality
kenwalger profile

The Backyard Quarry, Part 8: From Rocks to Reality

#architecture #dataengineering #sideprojects #systemdesign
2
Comments
4 min read
Databricks in Production: 8 Architectural Decisions That Actually Matter
dabhi_abhishek_9898 profile

Databricks in Production: 8 Architectural Decisions That Actually Matter

#databricks #dataengineering #productivity #data
Comments
10 min read
Cost Optimization Strategies for Databricks Workloads
raghav_sharma_0c5d39f61a9 profile

Cost Optimization Strategies for Databricks Workloads

#analytics #cloud #dataengineering #performance
1
Comments
3 min read
The 6 Python Data Engineering Interview Questions You Will Actually Be Asked in 2026
datadriven profile

The 6 Python Data Engineering Interview Questions You Will Actually Be Asked in 2026

#python #dataengineering #interview #career
Comments
10 min read
78K Tech Layoffs, 47% AI-Blamed: Is Data Engineering Safe?
datadriven profile

78K Tech Layoffs, 47% AI-Blamed: Is Data Engineering Safe?

#dataengineering #career #ai #beginners
Comments
7 min read
Why My Spark Container Keeps Exiting — Docker PID 1 and the Daemon Trap
lee_yao_cfeb14fb9b141b8c5 profile

Why My Spark Container Keeps Exiting — Docker PID 1 and the Daemon Trap

#docker #spark #dataengineering #devops
Comments 1
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.