DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Scaling Apache SeaTunnel for Enterprise: Billion-Level Data Processing and Intelligent Fault Tolerance in Real-World Use Cases
seatunnel profile

Scaling Apache SeaTunnel for Enterprise: Billion-Level Data Processing and Intelligent Fault Tolerance in Real-World Use Cases

#apacheseatunnel #bigdata #dataengineering #ai
5
Comments
9 min read
Inside Databases: BSTs, B-Trees, & LSM Trees
chameera profile

Inside Databases: BSTs, B-Trees, & LSM Trees

#database #dataengineering #datastructures
1
Comments
7 min read
My First Data Pipeline Project Using Airflow, Docker & Postgres (COVID API Edition)
mohhddhassan profile

My First Data Pipeline Project Using Airflow, Docker & Postgres (COVID API Edition)

#dataengineering #postgres #airflow #docker
6
Comments
2 min read
A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)
mohsinsheikhani profile

A Practical Guide to MLOps on AWS: Transforming Raw Data into AI-Ready Datasets with AWS Glue (Phase 02)

#aws #cloud #mlops #dataengineering
1
Comments 2
8 min read
How Excel is Used in Real-World Data Analysis
giddybyt profile

How Excel is Used in Real-World Data Analysis

#dataengineering #datascience #beginners #data
3
Comments
3 min read
A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)
mohsinsheikhani profile

A Practical Guide to MLOps on AWS: Streaming Data Ingestion with Kinesis Firehose (Phase 01)

#aws #serverless #mlops #dataengineering
Comments 2
8 min read
#34 50 Advanced SQL Queries Every Developer Should Know
flnzba profile

#34 50 Advanced SQL Queries Every Developer Should Know

#sql #database #dataengineering
2
Comments
7 min read
Setting Up Presto with Apache Superset using Docker 🐳 : Hands-On Guide
saurabhmahawar profile

Setting Up Presto with Apache Superset using Docker 🐳 : Hands-On Guide

#opensource #datascience #presto #dataengineering
Comments 2
3 min read
Understanding Consistency in PostgreSQL: A Deep Dive into the “C” in ACID
kfir-g profile

Understanding Consistency in PostgreSQL: A Deep Dive into the “C” in ACID

#dataengineering #postgres #consistency #softwareengineering
1
Comments
3 min read
What I Learned Cleaning 1 Million Rows of CSV Data Without Pandas
abrar_ahmed profile

What I Learned Cleaning 1 Million Rows of CSV Data Without Pandas

#csv #node #backend #dataengineering
5
Comments
2 min read
Building My First Real-Time Dashboard with ClickHouse and Streamlit: TrendLite Breakdown
mohhddhassan profile

Building My First Real-Time Dashboard with ClickHouse and Streamlit: TrendLite Breakdown

#clickhouse #dataengineering #python #streamlit
4
Comments
2 min read
From Reddit Trolls to Real-Time Analytics: Building an LLM-Powered Flink Deployment System
datasosneh profile

From Reddit Trolls to Real-Time Analytics: Building an LLM-Powered Flink Deployment System

#eventdriven #dataengineering #llm #go
3
Comments 1
7 min read
How to Handle Big Data Transformations Without Pandas (and My Favorite Workarounds)
abrar_ahmed profile

How to Handle Big Data Transformations Without Pandas (and My Favorite Workarounds)

#bigdata #dataengineering #node #machinelearning
5
Comments
3 min read
The Ultimate Linux Command Cheat Sheet for Data Engineers and Analysts
grayhat profile

The Ultimate Linux Command Cheat Sheet for Data Engineers and Analysts

#dataengineering #bash #datascience #python
89
Comments 4
4 min read
Interesting links - April 2025
rmoff profile

Interesting links - April 2025

#data #dataengineering #kafka #flink
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.