DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Day 29: Building a Production-Grade Real-Time ETL Pipeline with Spark & Delta
sandeepk27 profile

Day 29: Building a Production-Grade Real-Time ETL Pipeline with Spark & Delta

#dataengineering #spark #bigdata #python
Comments
1 min read
Production AI: Monitoring, Cost Optimization, and Operations
qvfagundes profile

Production AI: Monitoring, Cost Optimization, and Operations

#llm #dataengineering #mlops #machinelearning
Comments
9 min read
Building a Realistic Banking Dummy Data Generator with Bad-Data Simulation
menai993 profile

Building a Realistic Banking Dummy Data Generator with Bad-Data Simulation

#dataengineering #python #opensource #sql
Comments
1 min read
Schemas and Data Modelling in Power BI
petermuriya profile

Schemas and Data Modelling in Power BI

#analytics #data #dataengineering #microsoft
Comments
2 min read
Why the Google Cloud Professional Data Engineer Certification Still Matters in an AI-First World
sireesha_pulipati_842f9f1 profile

Why the Google Cloud Professional Data Engineer Certification Still Matters in an AI-First World

#googlecloud #certification #dataengineering
5
Comments
3 min read
Data Engineering Trends You Can’t Ignore in 2026
george_mbaka_62347347417a profile

Data Engineering Trends You Can’t Ignore in 2026

#programming #data #dataengineering #machinelearning
Comments
5 min read
The Day My PySpark DataFrame Changed Its Mind
manaswini_katari profile

The Day My PySpark DataFrame Changed Its Mind

#databricks #spark #dataframe #dataengineering
1
Comments
3 min read
Configuring Gravitino Lance REST Service
datastrato-yue profile

Configuring Gravitino Lance REST Service

#api #dataengineering #lance #gravitino101
Comments
5 min read
Day 26: Spark Streaming Joins
sandeepk27 profile

Day 26: Spark Streaming Joins

#dataengineering #spark #bigdata #python
Comments
1 min read
Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment
datapenguin profile

Exploring the Potential of AWS Glue Python Shell as a Long-Running Batch Execution Environment

#aws #dataengineering
4
Comments
7 min read
DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026
rushikesh_langale_42ac365 profile

DataOps 101: What It Is and Why Enterprises Can’t Ignore It in 2026

#beginners #dataengineering #devops
Comments
2 min read
Day 25: Streaming Aggregations in Spark
sandeepk27 profile

Day 25: Streaming Aggregations in Spark

#dataengineering #spark #bigdata #python
Comments
1 min read
What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)
rushikesh_langale_42ac365 profile

What Is Data Fabric Architecture? A Beginner’s Guide (Explained Simply)

#data #architecture #beginners #dataengineering
Comments
2 min read
Data Processing Does Not Belong in the Message Broker
novatechflow profile

Data Processing Does Not Belong in the Message Broker

#kafka #dataengineering #data
Comments
3 min read
Can you describe a complex data architecture you’ve designed or implemented in the past?
shruti_nakum profile

Can you describe a complex data architecture you’ve designed or implemented in the past?

#discuss #data #dataengineering
Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.