DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Part 1: Snowflake's Autonomous Future
taro_matsui_japan profile

Part 1: Snowflake's Autonomous Future

#snowflake #ai #dataengineering
Comments
8 min read
Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)
alexmercedcoder profile

Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)

#architecture #dataengineering #opensource
Comments
4 min read
A Developer’s Guide to Apache Kafka: From Basics to Architecture in One Read
varunpatil1709 profile

A Developer’s Guide to Apache Kafka: From Basics to Architecture in One Read

#architecture #beginners #dataengineering
1
Comments
5 min read
How to Get Filtered Amazon Reviews into a Pandas DataFrame in Under 50 Lines of Python
bah123 profile

How to Get Filtered Amazon Reviews into a Pandas DataFrame in Under 50 Lines of Python

#python #scraper #dataengineering
Comments
3 min read
Comparing CsvPath and SodaCL
david_kershaw_b6916404da6 profile

Comparing CsvPath and SodaCL

#data #dataengineering #sql #csv
Comments
4 min read
Star vs. Snowflake Schema
wangare_ profile

Star vs. Snowflake Schema

#architecture #database #dataengineering
Comments
4 min read
The Bear Awakens: From Pure Speed to Massive Endurance (640 Million Rows Tested)
betoalien profile

The Bear Awakens: From Pure Speed to Massive Endurance (640 Million Rows Tested)

#showdev #testing #dataengineering #performance
Comments
16 min read
Data Engineer — Người Kiến Tạo “Dòng Chảy Dữ Liệu” Trong Kỷ Nguyên Số
peter_nguyen_d4a2eb51814e profile

Data Engineer — Người Kiến Tạo “Dòng Chảy Dữ Liệu” Trong Kỷ Nguyên Số

#architecture #career #dataengineering
Comments
2 min read
Sustainability in retail is a Software Problem Now
codecraft154 profile

Sustainability in retail is a Software Problem Now

#architecture #dataengineering #softwareengineering
Comments
2 min read
Join Data from Anywhere: The Streaming SQL Engine That Bridges Databases, APIs, and Files
theodore_p_9749548f7dd03 profile

Join Data from Anywhere: The Streaming SQL Engine That Bridges Databases, APIs, and Files

#python #database #dataengineering #sql
8
Comments 1
17 min read
Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study
rosewabere profile

Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study

#spark #pyspark #grafana #dataengineering
Comments
5 min read
Part 1: Database Concepts & Architecture
datatechbridge profile

Part 1: Database Concepts & Architecture

#architecture #database #dataengineering
Comments
14 min read
AWS Glue ETL Jobs: Transform Your Data at Scale
devoteng1 profile

AWS Glue ETL Jobs: Transform Your Data at Scale

#aws #dataengineering #etl #awsbigdata
1
Comments
4 min read
Final Project Report 1: Schema Evolution Support on Apache SeaTunnel Flink Engine
seatunnel profile

Final Project Report 1: Schema Evolution Support on Apache SeaTunnel Flink Engine

#opensource #apacheseatunnel #bigdata #dataengineering
Comments
4 min read
I Built an ETL Pipeline That Actually Thinks & And Cut Token Costs by 52% (And Here's What I Learned)
sreeni5018 profile

I Built an ETL Pipeline That Actually Thinks & And Cut Token Costs by 52% (And Here's What I Learned)

#ai #dataengineering #performance #llm
1
Comments
17 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.