DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing
sagara profile

Trying Out Snowflake's Adaptive Warehouse — Auto-Scaling Compute Without Manual Sizing

#snowflake #dataengineering
Comments
10 min read
Backpressure in document pipelines is an architecture problem first
cy_ong_591 profile

Backpressure in document pipelines is an architecture problem first

#architecture #dataengineering #sre #systemdesign
Comments
2 min read
Why mixed document packs make extraction pipelines harder to trust
cy_ong_591 profile

Why mixed document packs make extraction pipelines harder to trust

#dataengineering #machinelearning #productivity #systemdesign
Comments
2 min read
Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)
santosh_ronanki_9438d5944 profile

Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)

#dataengineering #ai #webdev
3
Comments
2 min read
Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis
manveerchawla profile

Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis

#database #sql #dataengineering #data
6
Comments
31 min read
🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

Gemma 4 Challenge: Build With Gemma 4 Submission
adriens profile

🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

#devchallenge #gemmachallenge #gemma #dataengineering
9
Comments 4
4 min read
Understanding Apache Kafka: A Beginner's Guide to Real-time Data Streaming
nganga_njongo profile

Understanding Apache Kafka: A Beginner's Guide to Real-time Data Streaming

#kafka #python #dataengineering #data
Comments 2
4 min read
Why Real-Time Analytics Eventually Changes Your Database Architecture
mohhddhassan profile

Why Real-Time Analytics Eventually Changes Your Database Architecture

#clickhouse #postgres #dataengineering #architecture
3
Comments
4 min read
I Built Airflow DAG Studio — A Visual Drag-and-Drop Builder for Apache Airflow DAGs
datainteg profile

I Built Airflow DAG Studio — A Visual Drag-and-Drop Builder for Apache Airflow DAGs

#airflow #dataengineering #opensource #ai
Comments 1
1 min read
Time-Series Databases (InfluxDB/TimescaleDB)
godofgeeks profile

Time-Series Databases (InfluxDB/TimescaleDB)

#database #dataengineering #monitoring #postgres
1
Comments
8 min read
What I Learned From Reading 50 Data Pipeline Postmortems
andrew_tan_layline profile

What I Learned From Reading 50 Data Pipeline Postmortems

#dataengineering #kafka #softwareengineering #data
1
Comments
7 min read
ETL vs ELT: Which One Should You Use and Why?
nganga_njongo profile

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #elt #etl #cloud
1
Comments
6 min read
Tech Lost 150K Jobs in 2026. Data Engineering Gained 414%.
datadriven profile

Tech Lost 150K Jobs in 2026. Data Engineering Gained 414%.

#dataengineering #career #python #beginners
Comments
7 min read
TaskFlow API vs Traditional Operators in Apache Airflow
karen_langat_299784e2c330 profile

TaskFlow API vs Traditional Operators in Apache Airflow

#automation #data #dataengineering #python
3
Comments
3 min read
Your real-time analytics might not be real-time
2001asjad profile

Your real-time analytics might not be real-time

#dataengineering #cloud #iot #architecture
Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.