DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Epistemic Control Systems: Anchoring on Kafka
thatechmaestro profile

Epistemic Control Systems: Anchoring on Kafka

#architecture #dataengineering #distributedsystems #systemdesign
Comments
4 min read
Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches
ccinaza profile

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

#dataengineering #zohodeskapi #bigquery #elt
1
Comments
7 min read
The hidden system behind Tesla autonomy
eagleeyethinker profile

The hidden system behind Tesla autonomy

#featurestore #teslaautopilot #tesla #dataengineering
Comments
3 min read
Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR
beck_moulton profile

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

#machinelearning #python #dataengineering #healthtech
1
Comments
3 min read
Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas
quicknicco profile

Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

#automation #dataengineering #productivity #python
Comments
3 min read
Synthetic Data and the Privacy Problem: Beyond Alice and Bob
aawiegel profile

Synthetic Data and the Privacy Problem: Beyond Alice and Bob

#dataengineering #testing
1
Comments
10 min read
dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters
hantedyou_0106 profile

dbt + OpenLineage #1: Why dbt-ol Is a Post-Processor (Not a Plugin) — and Why It Matters

#dbt #openlineage #dataengineering #python
Comments
7 min read
Scaling Time-Series Data: Partitioning, Replication and Backup in Apache IoTDB
timechodb profile

Scaling Time-Series Data: Partitioning, Replication and Backup in Apache IoTDB

#database #devops #dataengineering #programming
Comments
6 min read
how i use cursor and ai agents to write dbt tests and documentation
shrouwoods profile

how i use cursor and ai agents to write dbt tests and documentation

#dbt #cursor #ai #dataengineering
1
Comments
2 min read
Apache Data Lakehouse Weekly: March 16 – April 2, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: March 16 – April 2, 2026

#news #data #dataengineering #opensource
1
Comments
7 min read
Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML
sommic profile

Feed Rescue: Converting Raw Ulta Scrapes into Google Merchant Center XML

#webscraping #python #node #dataengineering
1
Comments
5 min read
100 Spark Scenario Based Interview Questions and Answers
hannah_usmedynska profile

100 Spark Scenario Based Interview Questions and Answers

#career #data #dataengineering #interview
5
Comments 1
24 min read
ETL Pipeline: The 6-Phase Pattern That Cuts Debugging From Hours to Minutes
kunwar-jhamat profile

ETL Pipeline: The 6-Phase Pattern That Cuts Debugging From Hours to Minutes

#etl #dataengineering #programming #architecture
1
Comments
5 min read
Understanding ETL Pipelines: The Philosophy Behind Reliable Data Integration
kunwar-jhamat profile

Understanding ETL Pipelines: The Philosophy Behind Reliable Data Integration

#etl #dataengineering #programming #architecture
1
Comments
6 min read
Data Modeling for Agriculture: Combining Cash Flow and Average Daily Gain (ADG) in the Same Database
dom1ng0s profile

Data Modeling for Agriculture: Combining Cash Flow and Average Daily Gain (ADG) in the Same Database

#architecture #data #database #dataengineering
1
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.