DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Web Scraping vs Web Crawling: What's the Difference and When to Use Each

Web Scraping vs Web Crawling: What's the Difference and When to Use Each

3
Comments
12 min read
She had a PhD from MIT. She quit after 6 months because nobody knew what sls_txn_f47 meant.

She had a PhD from MIT. She quit after 6 months because nobody knew what sls_txn_f47 meant.

Comments
2 min read
Vectorizing Your Vitals: Converting 10GB of Apple Health Data into a Personal RAG Brain

Vectorizing Your Vitals: Converting 10GB of Apple Health Data into a Personal RAG Brain

1
Comments 1
4 min read
Agentic AI: The Next Frontier of Enterprise Intelligence

Agentic AI: The Next Frontier of Enterprise Intelligence

Comments
7 min read
The systems behind enterprise AI adoption success - IBM

The systems behind enterprise AI adoption success - IBM

2
Comments 1
5 min read
Working as a Data Engineer in a Bank: Technical Realities, Trade-offs, and Practical Strategies for Success

Working as a Data Engineer in a Bank: Technical Realities, Trade-offs, and Practical Strategies for Success

1
Comments
7 min read
How to Set Up a GitHub Profile README Using Markdown (Beginner Guide)

How to Set Up a GitHub Profile README Using Markdown (Beginner Guide)

2
Comments
2 min read
I Bombed the AWS Data Engineer Associate So Hard I Questioned My Entire Career. Then I Figured Out What I Was Doing Wrong.

I Bombed the AWS Data Engineer Associate So Hard I Questioned My Entire Career. Then I Figured Out What I Was Doing Wrong.

1
Comments
4 min read
Know your tokens. Own your costs.

Know your tokens. Own your costs.

6
Comments 4
16 min read
The Architecture of Silence: Abraham Wald and the Epistemology of Missing Data

The Architecture of Silence: Abraham Wald and the Epistemology of Missing Data

Comments
5 min read
La Arquitectura del Silencio: Abraham Wald y la EpistemologĂ­a de los Datos Ausentes

La Arquitectura del Silencio: Abraham Wald y la EpistemologĂ­a de los Datos Ausentes

Comments
6 min read
Apache Data Lakehouse Weekly: February 26 – March 5, 2026

Apache Data Lakehouse Weekly: February 26 – March 5, 2026

1
Comments
6 min read
🚀 Projeto ETL em Python com dados públicos de clima + MySQL na nuvem

🚀 Projeto ETL em Python com dados públicos de clima + MySQL na nuvem

Comments
2 min read
Top 5 Snowflake Data Ingestion Tools in 2026 (Compared & Reviewed)

Top 5 Snowflake Data Ingestion Tools in 2026 (Compared & Reviewed)

Comments
9 min read
How Linux Powers Real-World Data Engineering

How Linux Powers Real-World Data Engineering

2
Comments
14 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.