DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Issues of Multi-GB Spreadsheets in Data Lakes
toby-patrick profile

Issues of Multi-GB Spreadsheets in Data Lakes

#data #dataengineering #performance
Comments
4 min read
Asset-Based Data Orchestration: Lessons from Building a Multi-State Social Data Platform
engineering profile

Asset-Based Data Orchestration: Lessons from Building a Multi-State Social Data Platform

#dagster #dataorchestration #dataengineering
1
Comments
6 min read
The Backyard Quarry, Part 2: Designing a Schema for Physical Objects
kenwalger profile

The Backyard Quarry, Part 2: Designing a Schema for Physical Objects

#dataengineering #softwareengineering #backendengineering #datamodeling
2
Comments
5 min read
The Vinted Arbitrage War: Building a Scraper That Doesn't Get IP-Banned
datakaz profile

The Vinted Arbitrage War: Building a Scraper That Doesn't Get IP-Banned

#webdev #python #dataengineering #tutorial
Comments
9 min read
How to Build a Scalable Serverless Social Media Ingestion & Analytics Pipeline on AWS
capestart profile

How to Build a Scalable Serverless Social Media Ingestion & Analytics Pipeline on AWS

#aws #serverless #dataengineering
1
Comments
4 min read
Python, Data Engineering, and Community: Highlights from Python Asia 2026
cardinal_seen profile

Python, Data Engineering, and Community: Highlights from Python Asia 2026

#pythonasia2026 #dataengineering #communitybuilding #dataengineeringph
Comments
1 min read
Break Free from Wearable Silos: Building a Universal Health Data ETL with Health Connect & FHIR
beck_moulton profile

Break Free from Wearable Silos: Building a Universal Health Data ETL with Health Connect & FHIR

#android #dataengineering #healthtech #fhir
2
Comments
3 min read
The TLS Fingerprinting Hell: Why I Stopped Reverse-Engineering the Vinted App
datakaz profile

The TLS Fingerprinting Hell: Why I Stopped Reverse-Engineering the Vinted App

#webdev #python #dataengineering #security
Comments
5 min read
Feeding the Black Box: Engineering a Data Pipeline for Meta's Deep Learning Algorithms
hmb_berry profile

Feeding the Black Box: Engineering a Data Pipeline for Meta's Deep Learning Algorithms

#machinelearning #dataengineering #api #meta
2
Comments
3 min read
The systems behind enterprise AI adoption success - IBM
michaeltuszynski profile

The systems behind enterprise AI adoption success - IBM

#ai #architecture #dataengineering #systems
1
Comments 1
5 min read
Stateful AI: Streaming Long-Term Agent Memory with Amazon Kinesis
jubinsoni profile

Stateful AI: Streaming Long-Term Agent Memory with Amazon Kinesis

#aws #generativeai #dataengineering #amazonkinesis
2
Comments
6 min read
Cara Menggunakan API EMR: Panduan Lengkap
walse profile

Cara Menggunakan API EMR: Panduan Lengkap

#api #aws #dataengineering #tutorial
Comments
7 min read
LINUX AS THE NERVOUS SYSTEM OF DATA ENGINEERING
cnew_aerospace_85c7b7d3cb profile

LINUX AS THE NERVOUS SYSTEM OF DATA ENGINEERING

#dataengineering #luxdevhq #harunmbaabu #deeplearning
3
Comments
3 min read
Working as a Data Engineer in a Bank: Technical Realities, Trade-offs, and Practical Strategies for Success
chiefmojo79 profile

Working as a Data Engineer in a Bank: Technical Realities, Trade-offs, and Practical Strategies for Success

#architecture #career #dataengineering #workplace
1
Comments
7 min read
Automating Clinical Data Analysis: The Pipeline From Hospital Exports to Paper Drafts
local_ai_28441e061d716cb1 profile

Automating Clinical Data Analysis: The Pipeline From Hospital Exports to Paper Drafts

#automation #dataengineering #datascience #writing
1
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.