DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Data Engineer — Người Kiến Tạo “Dòng Chảy Dữ Liệu” Trong Kỷ Nguyên Số
peter_nguyen_d4a2eb51814e profile

Data Engineer — Người Kiến Tạo “Dòng Chảy Dữ Liệu” Trong Kỷ Nguyên Số

#architecture #career #dataengineering
Comments
2 min read
Sustainability in retail is a Software Problem Now
codecraft154 profile

Sustainability in retail is a Software Problem Now

#architecture #dataengineering #softwareengineering
Comments
2 min read
Join Data from Anywhere: The Streaming SQL Engine That Bridges Databases, APIs, and Files
theodore_p_9749548f7dd03 profile

Join Data from Anywhere: The Streaming SQL Engine That Bridges Databases, APIs, and Files

#python #database #dataengineering #sql
8
Comments 1
17 min read
Part 1: Database Concepts & Architecture
datatechbridge profile

Part 1: Database Concepts & Architecture

#architecture #database #dataengineering
Comments
14 min read
New release: LightningChart Python 2.1
lightningchart_dashtera profile

New release: LightningChart Python 2.1

#python #datascience #dataengineering #datavisualization
Comments
1 min read
Final Project Report 1: Schema Evolution Support on Apache SeaTunnel Flink Engine
seatunnel profile

Final Project Report 1: Schema Evolution Support on Apache SeaTunnel Flink Engine

#opensource #apacheseatunnel #bigdata #dataengineering
Comments
4 min read
I Built an ETL Pipeline That Actually Thinks & And Cut Token Costs by 52% (And Here's What I Learned)
sreeni5018 profile

I Built an ETL Pipeline That Actually Thinks & And Cut Token Costs by 52% (And Here's What I Learned)

#ai #dataengineering #performance #llm
2
Comments
17 min read
Firehose and Iceberg Tables
dmevanct profile

Firehose and Iceberg Tables

#programming #dataengineering #aws #awsdatalake
3
Comments
4 min read
Beyond SQL: Solving Data Warehouse Performance Bottlenecks with Smart Algorithms, Not Just Bigger Clusters
esproc_spl profile

Beyond SQL: Solving Data Warehouse Performance Bottlenecks with Smart Algorithms, Not Just Bigger Clusters

#algorithms #database #dataengineering #performance
5
Comments
13 min read
From Pandas to Upstream Control: The Evolution PyData Needs Next
aronchick profile

From Pandas to Upstream Control: The Evolution PyData Needs Next

#dataengineering #python #distributedsystems #machinelearning
Comments
6 min read
How to Sync Data from an Oracle Table to Elasticsearch using Kafka Connect
maghsood_esmaeili profile

How to Sync Data from an Oracle Table to Elasticsearch using Kafka Connect

#database #kubernetes #dataengineering #tutorial
1
Comments 1
5 min read
Statistics Day 2: Correlation Isn’t Causation — Here’s Why It Matters!
brains_behind_bots profile

Statistics Day 2: Correlation Isn’t Causation — Here’s Why It Matters!

#statistics #datascience #machinelearning #dataengineering
5
Comments
4 min read
Unpacking the Google File System Paper: A Simple Breakdown
rajeevrajeshuni profile

Unpacking the Google File System Paper: A Simple Breakdown

#distributedsystems #dataengineering #systemdesign #pwl
6
Comments
3 min read
Apache Dev List Digest: Iceberg, Polaris, Arrow & Parquet (Dec 9th - Dec15th, 2025)
alexmercedcoder profile

Apache Dev List Digest: Iceberg, Polaris, Arrow & Parquet (Dec 9th - Dec15th, 2025)

#news #dataengineering #opensource
1
Comments
7 min read
Kafka consumer lag—Measure and reduce
aime-bangirahe profile

Kafka consumer lag—Measure and reduce

#devops #performance #dataengineering #monitoring
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.