Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Data Pipelines Explained: The Heart of Data Engineering 🚀
Aadesh Gaikwad
Aadesh Gaikwad
Aadesh Gaikwad
Follow
Aug 21
Data Pipelines Explained: The Heart of Data Engineering 🚀
#
dataengineering
#
kafka
#
dataarchitecture
#
apachespark
1
 reaction
Comments
Add Comment
3 min read
Understanding the ORC File Format: Why Is It So Fast
Mohamed Hussain S
Mohamed Hussain S
Mohamed Hussain S
Follow
Aug 21
Understanding the ORC File Format: Why Is It So Fast
#
dataengineering
#
bigdata
#
database
#
python
3
 reactions
Comments
Add Comment
8 min read
What I Learned Contributing to Prefect, dbt, and Airflow (An Honest OSS Retrospective)
Bobby Ray
Bobby Ray
Bobby Ray
Follow
Aug 21
What I Learned Contributing to Prefect, dbt, and Airflow (An Honest OSS Retrospective)
#
dataengineering
#
opensource
#
career
#
airflow
Comments
Add Comment
4 min read
Model an Evidence Chain, Not a Bag of Citations
Kun Shen
Kun Shen
Kun Shen
Follow
Jul 18
Model an Evidence Chain, Not a Bag of Citations
#
ai
#
architecture
#
database
#
dataengineering
Comments
Add Comment
5 min read
Row and Field-Level Data Provenance: Why It's Worth the Pain (and Where the Pain Is)
Steven Blough
Steven Blough
Steven Blough
Follow
Jul 31
Row and Field-Level Data Provenance: Why It's Worth the Pain (and Where the Pain Is)
#
lineage
#
provenance
#
dataengineering
#
data
Comments
2
 comments
9 min read
Why AI Projects Fail Even with Great Models
Abhishek Konagalla
Abhishek Konagalla
Abhishek Konagalla
Follow
Jul 18
Why AI Projects Fail Even with Great Models
#
ai
#
machinelearning
#
dataengineering
#
softwareengineering
Comments
Add Comment
3 min read
One Histogram, Four Engines: Fixing the Statistics Silo Problem
AI Explore
AI Explore
AI Explore
Follow
Jul 22
One Histogram, Four Engines: Fixing the Statistics Silo Problem
#
rust
#
sql
#
dataengineering
#
iceberg
1
 reaction
Comments
Add Comment
5 min read
Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)
VBC Risk Analytics
VBC Risk Analytics
VBC Risk Analytics
Follow
Jul 18
Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)
#
architecture
#
dataengineering
#
python
#
softwareengineering
Comments
Add Comment
2 min read
World Cup Data Pipeline
Tommy
Tommy
Tommy
Follow
Jul 17
World Cup Data Pipeline
#
showdev
#
database
#
dataengineering
#
postgres
Comments
Add Comment
5 min read
How to preview a Parquet file without Python, pandas, or a running service
Aurelio Nakamura
Aurelio Nakamura
Aurelio Nakamura
Follow
Aug 20
How to preview a Parquet file without Python, pandas, or a running service
#
showdev
#
tutorial
#
dataengineering
#
python
Comments
Add Comment
3 min read
The AI Cheat Tool Your Interview Cannot See
DataDriven
DataDriven
DataDriven
Follow
Jul 16
The AI Cheat Tool Your Interview Cannot See
#
dataengineering
#
interview
#
career
#
beginners
Comments
Add Comment
6 min read
The Future of Data Engineering in 2026:7 Trends Every Data Engineer Should Know
Abhishek Konagalla
Abhishek Konagalla
Abhishek Konagalla
Follow
Jul 16
The Future of Data Engineering in 2026:7 Trends Every Data Engineer Should Know
#
dataengineering
#
ai
#
cloud
#
career
Comments
Add Comment
3 min read
Can We Stop Running Recurring Analysis as a Scheduled LLM Prompt?
Atsushi Hara
Atsushi Hara
Atsushi Hara
Follow
Aug 19
Can We Stop Running Recurring Analysis as a Scheduled LLM Prompt?
#
llm
#
dataengineering
#
architecture
#
automation
1
 reaction
Comments
3
 comments
7 min read
12 Patterns Run Every Data Stack. Seniority Is Knowing When Each One Is a Mistake.
Vinicius Fagundes
Vinicius Fagundes
Vinicius Fagundes
Follow
Jul 16
12 Patterns Run Every Data Stack. Seniority Is Knowing When Each One Is a Mistake.
#
ai
#
data
#
dataengineering
#
python
Comments
Add Comment
9 min read
How I Approach KPI Dashboard Design as a Data Engineer
ryo ariyama
ryo ariyama
ryo ariyama
Follow
Jul 16
How I Approach KPI Dashboard Design as a Data Engineer
#
data
#
dataengineering
#
analytics
#
datascience
Comments
Add Comment
4 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account