DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Streaming Crypto Changes: A Practical Guide to Real-Time Data Pipelines with Debezium CDC
j_m47 profile
J M

Streaming Crypto Changes: A Practical Guide to Real-Time Data Pipelines with Debezium CDC

#dataengineering #data #docker
Comments
3 min read
Fuzzy-match millions of rows in Databricks (2026)
siyana_hristova_900e581ee profile

Fuzzy-match millions of rows in Databricks (2026)

#datascience #dataengineering #databricks #bigdata
9
Comments
5 min read
AI Agents in Data Analytics: How Adeloop Bridges Autonomous Intelligence and Users
adeloop profile

AI Agents in Data Analytics: How Adeloop Bridges Autonomous Intelligence and Users

#ai #dataengineering #architecture #agents
1
Comments 1
2 min read
Lakehouse? More Like a Lake + Warehouse Parking Lot
esproc_spl profile
Judy

Lakehouse? More Like a Lake + Warehouse Parking Lot

#architecture #data #database #dataengineering
5
Comments
10 min read
Why AI Models Fail in Production — Even When Accuracy Looks High
naanhe_gujral_c001233100f profile

Why AI Models Fail in Production — Even When Accuracy Looks High

#ai #machinelearning #devops #dataengineering
Comments
1 min read
🕸️ I Just Deleted My Scraper Boilerplate: Meet the "One-Liner" Crawler
siddhesh_surve profile

🕸️ I Just Deleted My Scraper Boilerplate: Meet the "One-Liner" Crawler

#python #opensource #productivity #dataengineering
Comments
3 min read
From Splicing Fibers to Scaling Clouds: My Journey to the AWS Community
maureen_chepkirui_03c48a2 profile

From Splicing Fibers to Scaling Clouds: My Journey to the AWS Community

#aws #cloudcomputing #dataengineering #fiberoptics
Comments
2 min read
Manual Relationship Discovery Does Not Scale.Not Even With SQL.
hello_arisyn_0dc948aa82b3 profile

Manual Relationship Discovery Does Not Scale.Not Even With SQL.

#dataengineering #dataintegration #dataarchitecture #scalability
Comments 1
2 min read
Building an Automated Data Pipeline
maureen_chepkirui_03c48a2 profile

Building an Automated Data Pipeline

#aws #dataengineering #python #cloud
Comments
2 min read
Linux for Data Engineers: From Terminal to Text Editing
edmund_eryuba profile

Linux for Data Engineers: From Terminal to Text Editing

#linux #dataengineering #opensource
Comments
16 min read
Building Production ETL Pipelines in Node.js with HazelJS Data
arslan_mecom profile

Building Production ETL Pipelines in Node.js with HazelJS Data

#dataengineering #node #tutorial #typescript
Comments
9 min read
Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute
hello_arisyn_0dc948aa82b3 profile

Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute

#scalablesystems #dataengineering #distributedsystems #bigdata
1
Comments 1
2 min read
The Three Phases of Data Pipelines
thanh_truong_a99577c6b879 profile

The Three Phases of Data Pipelines

#technology #dataengineering #systemdesign
Comments
4 min read
Schemas and Data Modelling in Power B.I
davi__mungai profile
David

Schemas and Data Modelling in Power B.I

#analytics #data #dataengineering #microsoft
1
Comments
3 min read
Architecture of a 6TB Media Pipeline: Engineering Real-Time Content at Bharat Drone Shakti
pranjal_csmedia profile

Architecture of a 6TB Media Pipeline: Engineering Real-Time Content at Bharat Drone Shakti

#architecture #dataengineering #performance #systemdesign
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.