DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Design a web crawler: the system design interview walkthrough
gowthampotureddi profile

Design a web crawler: the system design interview walkthrough

#python #sql #interview #dataengineering
Comments
15 min read
How to Design an IoT Data Pipeline for Multi-Frequency Measurements
timecho profile

How to Design an IoT Data Pipeline for Multi-Frequency Measurements

#iot #database #dataengineering #opensource
5
Comments
5 min read
Design a distributed cache: the system design interview guide
gowthampotureddi profile

Design a distributed cache: the system design interview guide

#python #sql #interview #dataengineering
Comments 1
16 min read
Treat product assortment as a data problem, not a catalog spreadsheet
anakin_writers profile

Treat product assortment as a data problem, not a catalog spreadsheet

#ecommerce #sql #dataengineering #analytics
Comments
5 min read
Entry-Level Data Engineer Jobs: Stanford's 19% Gap vs BLS's 35%
datadriven profile

Entry-Level Data Engineer Jobs: Stanford's 19% Gap vs BLS's 35%

#dataengineering #career #interview #ai
Comments
8 min read
Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline
omayrashraf profile

Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline

#aws #dataengineering #etl #postgres
Comments
5 min read
Extracting data from hundreds of PDFs into Excel (and why a converter is not enough)
fabienk profile

Extracting data from hundreds of PDFs into Excel (and why a converter is not enough)

#ocr #pdf #automation #dataengineering
Comments 1
5 min read
Airflow 3 quietly changed what your cron schedule means
itcraftsman profile

Airflow 3 quietly changed what your cron schedule means

#airflow #dataengineering #python #etl
Comments
3 min read
Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level Attribution
aidatalegends profile

Databricks SQL Serverless Cost Governance: Budgets, Alerts, and Query-Level Attribution

#costoptimization #dataengineering #databricks #finops
Comments
3 min read
Polars 2.0: five things that change when you upgrade, three of them silently
ground_truth_books profile

Polars 2.0: five things that change when you upgrade, three of them silently

#polars #python #dataengineering #datascience
Comments
4 min read
A traceability import should never guess a missing lot code
chrissellers profile

A traceability import should never guess a missing lot code

#dataengineering #api #python #supplychain
Comments
4 min read
Design a Payment System: the system design interview walkthrough
gowthampotureddi profile

Design a Payment System: the system design interview walkthrough

#python #sql #interview #dataengineering
Comments
14 min read
Design WhatsApp: the chat system design interview walkthrough
gowthampotureddi profile

Design WhatsApp: the chat system design interview walkthrough

#python #sql #interview #dataengineering
Comments
14 min read
An AI-Assisted Development Methodology, Earned from Real Incidents
antonio_zhu_e726fd856cd86 profile

An AI-Assisted Development Methodology, Earned from Real Incidents

#vibecoding #softwareengineering #dataengineering
Comments
25 min read
Parquet vs CSV: what you actually save, and why
mohammed_arshadansari_f2 profile

Parquet vs CSV: what you actually save, and why

#dataengineering #python #data
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.