DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The Real-Time Trap: Why Fresh Data Might Be Slowing Down Your Dashboards
thanh_truong_a99577c6b879 profile

The Real-Time Trap: Why Fresh Data Might Be Slowing Down Your Dashboards

#technology #dataengineering #latency #systemdesign
Comments 2
4 min read
Useful Linux Commands For Data Engineers
valgrace profile

Useful Linux Commands For Data Engineers

#dataengineering #linux #vim #ssh
Comments
4 min read
Introduction to Linux for Data Engineers
petermuriya profile

Introduction to Linux for Data Engineers

#beginners #dataengineering #linux #tutorial
Comments
3 min read
The Missing Step in RAG: Why Your Vector DB is Bloated (and how to fix it locally)
damiansiuta profile

The Missing Step in RAG: Why Your Vector DB is Bloated (and how to fix it locally)

#dataengineering #rag #python #opensource
1
Comments
3 min read
Data Quality at Scale: Validating Scrapes with Pydantic
deepak_mishra_35863517037 profile

Data Quality at Scale: Validating Scrapes with Pydantic

#automation #codequality #dataengineering #python
3
Comments 2
13 min read
Building a CDC Skyscraper: How SeaTunnel Leverages Debezium Under the Hood
seatunnel profile

Building a CDC Skyscraper: How SeaTunnel Leverages Debezium Under the Hood

#dataengineering #database #opensource #architecture
Comments
3 min read
Medallion Architecture 101: Building Data Pipelines That Don't Fall Apart
aawiegel profile

Medallion Architecture 101: Building Data Pipelines That Don't Fall Apart

#dataengineering #database #python #sql
Comments
11 min read
Amazon S3 Tables Just Got Smarter: Intelligent-Tiering & Native Replication Explained
sumsuzzaman profile

Amazon S3 Tables Just Got Smarter: Intelligent-Tiering & Native Replication Explained

#aws #dataengineering #analytics #cloud
Comments
4 min read
Pipelines, ETL, and Warehouses: The DNA of Data Engineering
qvfagundes profile

Pipelines, ETL, and Warehouses: The DNA of Data Engineering

#dataengineering #datascience #beginners #career
5
Comments 2
4 min read
My Friday "Sanity Savers" (Software, Data & DevOps edition) 🛠️
bhoyee profile

My Friday "Sanity Savers" (Software, Data & DevOps edition) 🛠️

#devops #dataengineering #python #productivity
Comments 1
1 min read
Bulletproof Power Query (Part 2): A Smart, Fuzzy-Match Rename Function
essam404 profile

Bulletproof Power Query (Part 2): A Smart, Fuzzy-Match Rename Function

#powerquery #powerbi #dataengineering #excel
Comments
4 min read
System Architecture Analysis: The Data Pipeline Issues of TraderKnows
bittam profile

System Architecture Analysis: The Data Pipeline Issues of TraderKnows

#dataengineering #fintech #traderknows #webscraping
Comments
2 min read
Building an AI-Powered Customer Churn Prediction Pipeline on AWS (Step-by-Step)
wanjohichristopher profile

Building an AI-Powered Customer Churn Prediction Pipeline on AWS (Step-by-Step)

#aws #machinelearning #dataengineering #python
2
Comments
5 min read
Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms
mahendran_a3347c2dfcca93e profile

Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms

#dataengineering #finops #bigdata #costoptimization
Comments
9 min read
Introducing `everyrow.io/dedupe`: An LLM-based approach to semantic deduplication
rafael_poyiadzi_85c2eed09 profile

Introducing `everyrow.io/dedupe`: An LLM-based approach to semantic deduplication

#showdev #data #dataengineering #llm
2
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.