Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Ashish Kumar

Apr 9

How Google Maps Predicts Traffic in Real Time: Live Data and ETA Explained

#googlemaps #traffic #gps #dataengineering

3 min read

Alex Merced

Mar 6

How to Use Dremio with Claude Code: Connect, Query, and Build Data Apps

#ai #dataengineering #mcp #tutorial

13 min read

Damaa-C

Mar 19

How to Connect Power BI to a SQL (PostgreSQL) Database and Build a Unified Dashboard

#discuss #database #postgres #dataengineering

4 min read

Manuel Weiss

Mar 6

Database Branch Testing: How Isolated Environments Improve QA Confidence

#database #dataengineering

11 min read

Aki for AWS Community Builders

Mar 6

Boosting Lightweight ETL on AWS Lambda & Glue Python Shell with DuckDB and Apache Arrow Dataset

#aws #duckdb #chdb #dataengineering

9 min read

Krishna Tangudu

Mar 18

Part 2: Zero-Copy data federation Snowflake Customer 360 Data to Salesforce Sales Reps

#cloud #dataengineering #salesforce #snowflake

4 min read

Chen Debra

Mar 5

Part 4 | Why State Machines Power Reliable Scheduling Systems

#architecture #dataengineering #opensource #systemdesign

6 min read

Beck_Moulton

Mar 9

Quantified Self: Building a Production-Grade ETL Pipeline for 10+ Wearables

#python #dataengineering #opensource #airflow

4 min read

Baldur12

Mar 4

Our Data Extraction Pipeline Worked Perfectly… Until Month 6

#dataengineering #datascience #datastructures #dataextraction

2 min read

Jerry A. Henley

Mar 5

Share of Shelf Analysis: How to Scrape Zappos Search Results

#webdev #devops #webscraping #dataengineering

4 min read

Kunwar Jhamat

Mar 5

Iterator Patterns: How to Process Millions of Records Without Running Out of Memory

#php #programming #dataengineering #performance

5 min read

Mohamed Hussain S

Apr 7

Why My Metrics Pipeline with Telegraf Didn’t Work (and What I Learned)

#dataengineering #clickhouse #devops #observability

2 min read

Vibhu Gupta

Mar 8

9 Data Engineering Challenges That Kill Pipelines in Production (And How I approached Them With Pure Snowflake SQL)

#snowflake #dataengineering #sql #datapipeline

14 min read

Vignesh

Apr 7

How I stopped bad data from reaching my warehouse using a single Airflow task

#dataengineering #airflow #python #api

4 min read

shubham pandey (Connoisseur)

Mar 8

History of Kafka the message broker

#architecture #dataengineering #distributedsystems #systemdesign

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

How Google Maps Predicts Traffic in Real Time: Live Data and ETA Explained

How to Use Dremio with Claude Code: Connect, Query, and Build Data Apps

How to Connect Power BI to a SQL (PostgreSQL) Database and Build a Unified Dashboard

Database Branch Testing: How Isolated Environments Improve QA Confidence

Boosting Lightweight ETL on AWS Lambda & Glue Python Shell with DuckDB and Apache Arrow Dataset

Part 2: Zero-Copy data federation Snowflake Customer 360 Data to Salesforce Sales Reps

Part 4 | Why State Machines Power Reliable Scheduling Systems

Quantified Self: Building a Production-Grade ETL Pipeline for 10+ Wearables

Our Data Extraction Pipeline Worked Perfectly… Until Month 6

Share of Shelf Analysis: How to Scrape Zappos Search Results

Iterator Patterns: How to Process Millions of Records Without Running Out of Memory

Why My Metrics Pipeline with Telegraf Didn’t Work (and What I Learned)

9 Data Engineering Challenges That Kill Pipelines in Production (And How I approached Them With Pure Snowflake SQL)

How I stopped bad data from reaching my warehouse using a single Airflow task

History of Kafka the message broker