DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Backpressure in document pipelines is an architecture problem first
cy_ong_591 profile

Backpressure in document pipelines is an architecture problem first

#architecture #dataengineering #sre #systemdesign
Comments
2 min read
Why mixed document packs make extraction pipelines harder to trust
cy_ong_591 profile

Why mixed document packs make extraction pipelines harder to trust

#dataengineering #machinelearning #productivity #systemdesign
Comments
2 min read
Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)
santosh_ronanki_9438d5944 profile

Why Cursor AI Won't Replace Data Engineers (And How to Actually Use It)

#dataengineering #ai #webdev
3
Comments
2 min read
Why Real-Time Analytics Eventually Changes Your Database Architecture
mohhddhassan profile

Why Real-Time Analytics Eventually Changes Your Database Architecture

#clickhouse #postgres #dataengineering #architecture
3
Comments
4 min read
Time-Series Databases (InfluxDB/TimescaleDB)
godofgeeks profile

Time-Series Databases (InfluxDB/TimescaleDB)

#database #dataengineering #monitoring #postgres
1
Comments
8 min read
🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

Gemma 4 Challenge: Build With Gemma 4 Submission
adriens profile

🧞‍♂️Transform unstructured PDFs Job Offers into a dataset w. gemma4:2b

#devchallenge #gemmachallenge #gemma #dataengineering
9
Comments 3
4 min read
PostgreSQL to Snowflake: A Hands-On CDC Streaming Guide
techsourabh profile

PostgreSQL to Snowflake: A Hands-On CDC Streaming Guide

#postgres #dataengineering #changedatacapture #snowflake
Comments
13 min read
ETL vs ELT: Which One Should You Use and Why?
nganga_njongo profile

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #elt #etl #cloud
1
Comments
6 min read
TaskFlow API vs Traditional Operators in Apache Airflow
karen_langat_299784e2c330 profile

TaskFlow API vs Traditional Operators in Apache Airflow

#automation #data #dataengineering #python
3
Comments
3 min read
Your real-time analytics might not be real-time
2001asjad profile

Your real-time analytics might not be real-time

#dataengineering #cloud #iot #architecture
Comments
1 min read
What is Apache Arrow? Erasing the Serialization Tax
alexmercedcoder profile

What is Apache Arrow? Erasing the Serialization Tax

#architecture #dataengineering #opensource #performance
Comments
3 min read
ETL vs ELT: Which One Should You Use and Why?
petermuriya profile

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #etl #elt #bigdata
Comments
5 min read
Mastering SQL Fundamentals: From Data Definition to Data Transformation
lorraine_njagi_k profile

Mastering SQL Fundamentals: From Data Definition to Data Transformation

#sql #database #dataengineering #datascience
Comments
3 min read
How Apache Kafka Powers Real-Time Data Pipelines
cliffe_okoth profile

How Apache Kafka Powers Real-Time Data Pipelines

#eventdriven #kafka #ai #dataengineering
1
Comments 1
3 min read
Assembling the Apache Lakehouse: The Modular Architecture
alexmercedcoder profile

Assembling the Apache Lakehouse: The Modular Architecture

#architecture #data #dataengineering #opensource
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.