DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
1. "Python Program to Filter CSV Rows and Write Output to New File"

1. "Python Program to Filter CSV Rows and Write Output to New File"

Comments
3 min read
Calculate the Hierarchy of Recursive References — From SQL to SPL #11

Calculate the Hierarchy of Recursive References — From SQL to SPL #11

5
Comments 1
2 min read
Study Notes dlt Workshop: API, Warehouses, Data Lakes

Study Notes dlt Workshop: API, Warehouses, Data Lakes

Comments 1
5 min read
🚀 We Just Launched Stof – An Open-Source Project to Simplify Data Handling!

🚀 We Just Launched Stof – An Open-Source Project to Simplify Data Handling!

Comments
2 min read
Module 3 of DataTalks club Data Engg bootcamp.

Module 3 of DataTalks club Data Engg bootcamp.

Comments
1 min read
Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

1
Comments
7 min read
Study Notes 6.5-6: Kafka Producer, Consumer & Configuration

Study Notes 6.5-6: Kafka Producer, Consumer & Configuration

1
Comments
7 min read
Study Note 3.3.2: BigQuery Machine Learning Model Deployment using Docker

Study Note 3.3.2: BigQuery Machine Learning Model Deployment using Docker

Comments
4 min read
Study Notes 3.3.1: BigQuery Machine Learning (BQML)

Study Notes 3.3.1: BigQuery Machine Learning (BQML)

Comments
4 min read
Study Notes: Data Query on S3 Bucket Using Athena

Study Notes: Data Query on S3 Bucket Using Athena

Comments
3 min read
Study Notes 3.2.2: BigQuery Internal Architecture

Study Notes 3.2.2: BigQuery Internal Architecture

Comments
2 min read
Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Comments
3 min read
Pandas Mindmap: A Visual Guide to DataFrame Manipulation

Pandas Mindmap: A Visual Guide to DataFrame Manipulation

2
Comments 1
1 min read
Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

Comments
3 min read
Study Note 3.2.1: BigQuery Best Practices

Study Note 3.2.1: BigQuery Best Practices

Comments
3 min read
The Role of Data Engineering in Driving AI and Advanced Analytics

The Role of Data Engineering in Driving AI and Advanced Analytics

Comments
3 min read
Calculate Monthly Account Balance and Fill in Missing Dates — From SQL to SPL #10

Calculate Monthly Account Balance and Fill in Missing Dates — From SQL to SPL #10

6
Comments 1
2 min read
Building Scalable Data Pipelines with Python – A Complete Guide

Building Scalable Data Pipelines with Python – A Complete Guide

Comments
2 min read
Implementing Real-Time Data Processing Using Apache Flink

Implementing Real-Time Data Processing Using Apache Flink

Comments
3 min read
JSON, CSV, and Parquet: Guardians of Data

JSON, CSV, and Parquet: Guardians of Data

Comments
5 min read
How fault-tolerance works in Flink

How fault-tolerance works in Flink

1
Comments
3 min read
Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Comments
4 min read
Azure For Data Engineering

Azure For Data Engineering

5
Comments
3 min read
Doing DE job as DS

Doing DE job as DS

Comments 1
2 min read
My First Post on DEV

My First Post on DEV

Comments
1 min read
loading...