DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
From STTM to Snowflake SQL: Building a Metadata-Driven Data Engineering Copilot
amising6 profile

From STTM to Snowflake SQL: Building a Metadata-Driven Data Engineering Copilot

#dataengineering #ai #snowflake #etl
Comments 1
1 min read
I Built a World Cup Prediction Model That Retrains Itself Daily and Can't Cheat Its Own Results âš˝
de_clerke profile

I Built a World Cup Prediction Model That Retrains Itself Daily and Can't Cheat Its Own Results âš˝

#machinelearning #dataengineering #python #sportsdata
3
Comments
7 min read
Why did my DataFrame lose rows? Debugging silent pandas pipeline failures
vimal_nakrani profile

Why did my DataFrame lose rows? Debugging silent pandas pipeline failures

#python #datascience #pandas #dataengineering
Comments
5 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#aws #dataengineering #devops #infrastructure
Comments
9 min read
Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms
hasanhaider profile

Airflow Version Upgrade for Enterprises: A Practical Blueprint for AWS, Snowflake, dbt, and Fintech Data Platforms

#automation #aws #dataengineering #devops
Comments
9 min read
Why Most Sports Betting Projects Fail Before Launch (And It's Not the Algorithm)
drengregious profile

Why Most Sports Betting Projects Fail Before Launch (And It's Not the Algorithm)

#dataengineering #sideprojects #softwaredevelopment #api
Comments
2 min read
ClickHouse Duplicates: Clean Your Results vs. Clean Your Storage
mohhddhassan profile

ClickHouse Duplicates: Clean Your Results vs. Clean Your Storage

#clickhouse #database #dataengineering #sql
3
Comments
3 min read
How I streamed Gigabytes of Data directly to Disk using the browser's File System API
contextmuse profile

How I streamed Gigabytes of Data directly to Disk using the browser's File System API

#javascript #webdev #react #dataengineering
2
Comments
2 min read
Apache Data Lakehouse Weekly: June 4 to June 11, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: June 4 to June 11, 2026

#news #database #dataengineering #opensource
Comments 1
25 min read
Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering
petermuriya profile

Streamlining ETL Pipelines with Docker and Docker Compose in Data Engineering

#automation #dataengineering #devops #docker
Comments
3 min read
Why PDF-Style RAG Fails on Structured Enterprise Data
zeeshan_ghazanfar_97 profile

Why PDF-Style RAG Fails on Structured Enterprise Data

#ai #database #dataengineering #rag
Comments 1
1 min read
Data Engineering Pipeline: Understanding ETL vs ELT
sudoruss profile

Data Engineering Pipeline: Understanding ETL vs ELT

#dataengineering #python #tutorial
3
Comments 1
2 min read
Foundational Concepts in Data Engineering Using an E-Commerce Platform Example
motanga profile
MJ-O

Foundational Concepts in Data Engineering Using an E-Commerce Platform Example

#architecture #beginners #data #dataengineering
1
Comments
8 min read
Linux Fundamentals for Data Engineering
kiplangat_brian profile

Linux Fundamentals for Data Engineering

#linux #dataengineering #postgres #beginners
1
Comments
6 min read
How to Query Parquet Files in Object Storage with BigQuery External Tables
mirlan_de profile

How to Query Parquet Files in Object Storage with BigQuery External Tables

#dataengineering #bigquery #opensource #tutorial
1
Comments 1
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.