DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Frontend Teams Should Care About Data Modeling for Real-Time Dashboards
mdflaher profile

Why Frontend Teams Should Care About Data Modeling for Real-Time Dashboards

#dataengineering #analytics
Comments
2 min read
Refactoring a Mature Airflow Project: A Practical Guide to Scaling from Solo Development to Team Collaboration
ajitkumar profile

Refactoring a Mature Airflow Project: A Practical Guide to Scaling from Solo Development to Team Collaboration

#airflow #python #datascience #dataengineering
Comments
4 min read
Your 2026 Resolution: Add Context to Your Data (Before It Breaks You)
aronchick profile

Your 2026 Resolution: Add Context to Your Data (Before It Breaks You)

#dataengineering #aiinfrastructure #contextengineering #dataquality
Comments 1
10 min read
Context Engineering (Part 1): The Architecture of Recall
mosiddi profile

Context Engineering (Part 1): The Architecture of Recall

#dataengineering #rags #informationretrieval #vectorsearch
Comments 1
3 min read
Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers
sandeepk27 profile

Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers

#python #dataengineering #spark #bigdata
Comments
2 min read
AWSChallenge - Week 2
andresguecha profile

AWSChallenge - Week 2

#ai #dataengineering #aws #programming
Comments
4 min read
Day 10: Partitioning vs Bucketing - The Spark Optimization Guide Every Data Engineer Needs
sandeepk27 profile

Day 10: Partitioning vs Bucketing - The Spark Optimization Guide Every Data Engineer Needs

#python #dataengineering #spark #bigdata
Comments
2 min read
Deepening My Roots in the Data Ecosystem - Choosing Depth Over Breadth
jongwan93 profile

Deepening My Roots in the Data Ecosystem - Choosing Depth Over Breadth

#career #dataengineering #devjournal
Comments
2 min read
Automate Python Manual Extraction: Build End-to-End PDF -> LLM -> SQL Flows with CocoIndex, Ollama, and Postgres
badmonster0 profile

Automate Python Manual Extraction: Build End-to-End PDF -> LLM -> SQL Flows with CocoIndex, Ollama, and Postgres

#python #llm #dataengineering #etl
Comments
3 min read
The Boring Debug Checklist That Fixes Most “RAG Failures”
dowhatmatters profile

The Boring Debug Checklist That Fixes Most “RAG Failures”

#rag #dataengineering #llm #architecture
Comments
2 min read
AWS Lambda and AWS Glue Python Shell in the Context of Lightweight ETL
datapenguin profile

AWS Lambda and AWS Glue Python Shell in the Context of Lightweight ETL

#aws #dataengineering #etl
3
Comments
7 min read
SQL: Doing GROUP BY in CsvPath
david_kershaw_b6916404da6 profile

SQL: Doing GROUP BY in CsvPath

#sql #dataengineering #csv #csvpath
Comments
5 min read
Apache Airflow: Complete Guide for Basic to Advanced Developers
datatechbridge profile

Apache Airflow: Complete Guide for Basic to Advanced Developers

#dataengineering #devops #python #airflow
3
Comments
22 min read
đŸ”„ Day 3: RDDs - The Foundation of Spark
sandeepk27 profile

đŸ”„ Day 3: RDDs - The Foundation of Spark

#distributedsystems #interview #dataengineering #tutorial
Comments
2 min read
đŸ”„ Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified
sandeepk27 profile

đŸ”„ Day 4: RDD Internals - Partitions, Shuffles & Repartitioning Demystified

#spark #dataengineering #bigdata #python
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.