DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How Netflix Turns 2 Trillion Daily Events Into Architectural Decisions (And How You Can Too)
david_marcelopetrocelli_ profile

How Netflix Turns 2 Trillion Daily Events Into Architectural Decisions (And How You Can Too)

#architecture #microservices #dataengineering #netflix
1
Comments
14 min read
S&OP Engineering II: Demand Planning from Guessing to Probability
dalaez profile

S&OP Engineering II: Demand Planning from Guessing to Probability

#analytics #dataengineering #datascience #machinelearning
3
Comments
4 min read
Debugging & Refactoring Spaghetti Code - The A.I Special 🤖
blocool profile

Debugging & Refactoring Spaghetti Code - The A.I Special 🤖

#ai #programming #dataengineering #api
1
Comments
5 min read
Mastering SQL Joins and Window Functions: A Practical Guide with Example Data
damaac profile

Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

#learning #dataengineering #data #developer
3
Comments
4 min read
Why Travel Technology is the Next Frontier for AI Investment
airtruffle profile

Why Travel Technology is the Next Frontier for AI Investment

#traveltech #ai #investment #dataengineering
Comments
7 min read
Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)
patitonav profile

Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

#serverless #dataengineering #cloud #tutorial
14
Comments
5 min read
Data Pipeline Architecture: From Messy CSVs to Clean Database
n3x1s profile

Data Pipeline Architecture: From Messy CSVs to Clean Database

#python #dataengineering #tutorial #database
Comments
5 min read
Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector
datapenguin profile

Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector

#aws #snowflake #dataengineering
6
Comments
6 min read
Epistemic Control Systems: Anchoring on Kafka
thatechmaestro profile

Epistemic Control Systems: Anchoring on Kafka

#architecture #dataengineering #distributedsystems #systemdesign
Comments
4 min read
Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches
ccinaza profile

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

#dataengineering #zohodeskapi #bigquery #elt
1
Comments
7 min read
Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas
quicknicco profile

Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

#automation #dataengineering #productivity #python
Comments
3 min read
Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR
beck_moulton profile

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

#machinelearning #python #dataengineering #healthtech
1
Comments
3 min read
Synthetic Data and the Privacy Problem: Beyond Alice and Bob
aawiegel profile

Synthetic Data and the Privacy Problem: Beyond Alice and Bob

#dataengineering #testing
1
Comments
10 min read
how i use cursor and ai agents to write dbt tests and documentation
shrouwoods profile

how i use cursor and ai agents to write dbt tests and documentation

#dbt #cursor #ai #dataengineering
1
Comments
2 min read
dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters
hantedyou_0106 profile

dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters

#dbt #openlineage #dataengineering #python
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.