DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A Beginner’s Guide to DDL and DML in SQL
keim profile

A Beginner’s Guide to DDL and DML in SQL

#sql #database #datascience #dataengineering
Comments
4 min read
The Data Engineering Lifecycle
mirinagonzales profile

The Data Engineering Lifecycle

#architecture #data #dataengineering
Comments
3 min read
Data Anomaly Detection: The Complete Guide for Data Engineers
iblaine profile

Data Anomaly Detection: The Complete Guide for Data Engineers

#dataengineering #dataquality
Comments
7 min read
You Don't Need to Write Data Tests
iblaine profile

You Don't Need to Write Data Tests

#dataengineering #dataquality
Comments
8 min read
The Context Layer: Why Enterprise AI Agents Fail Without It — and What It Actually Takes to Fix That
swapnil_chougule profile

The Context Layer: Why Enterprise AI Agents Fail Without It — and What It Actually Takes to Fix That

#enterprise #ai #dataengineering #agents
2
Comments 1
13 min read
From Glue to Horizon: Our Real Journey Building an Iceberg Lakehouse on Snowflake
swaroop_krishna_e2f4b83b2 profile

From Glue to Horizon: Our Real Journey Building an Iceberg Lakehouse on Snowflake

#architecture #aws #dataengineering #snowflake
Comments
10 min read
From Transactions to Insights: How OLTP and OLAP Work Together in Modern Data Pipelines
byrone_code profile

From Transactions to Insights: How OLTP and OLAP Work Together in Modern Data Pipelines

#datascience #datawarehousing #ai #dataengineering
2
Comments
4 min read
Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨
databro profile

Query CSV, Excel, Parquet, and Arrow files in the Browser with DuckDB-Wasm + Next.js 🦆✨

#duckdb #nextjs #dataengineering #database
Comments 1
4 min read
Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight
l0gi0ver profile

Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight

#webscraping #apify #socialmedia #dataengineering
Comments
3 min read
Comparing approaches to extracting Hacker News Who Is Hiring data
l0gi0ver profile

Comparing approaches to extracting Hacker News Who Is Hiring data

#webscraping #apify #jobs #dataengineering
Comments
3 min read
Sample dataset analysis: a 100-row snapshot of Bazaraki
l0gi0ver profile

Sample dataset analysis: a 100-row snapshot of Bazaraki

#webscraping #apify #realestate #dataengineering
Comments
3 min read
Fraud Detection and Recommendation Are the Same Pipeline. Most Teams Build Two.
fagundesv profile

Fraud Detection and Recommendation Are the Same Pipeline. Most Teams Build Two.

#architecture #dataengineering #machinelearning #systemdesign
Comments
3 min read
From Manual Coordination to Prompt‑Driven Automation
kartikanand_45 profile

From Manual Coordination to Prompt‑Driven Automation

#businessintelligence #automation #microsoftfabricpower #dataengineering
Comments
4 min read
PySpark to Pandas/scikit-learn: A Practical Migration Guide for Data Engineers Learning ML
nyson_mark profile

PySpark to Pandas/scikit-learn: A Practical Migration Guide for Data Engineers Learning ML

#dataengineering #datascience #machinelearning #python
Comments
7 min read
ETL vs. ELT: Which Approach Should You Use and Why?
gathurum profile

ETL vs. ELT: Which Approach Should You Use and Why?

#architecture #beginners #data #dataengineering
1
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.