Skip to content
Navigation menu
Search
Powered by
Search
Algolia
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 31 '24
Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes
#
database
#
datascience
#
dataengineering
#
dataanalytics
1
reaction
Comments
Add Comment
19 min read
Data Modeling - Entities and Events
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 30 '24
Data Modeling - Entities and Events
#
database
#
dataengineering
#
datamodeling
#
dataanalytics
1
reaction
Comments
Add Comment
6 min read
Data Engineering in Observability: The Backbone of Modern Monitoring
Emmanuel Awa
Emmanuel Awa
Emmanuel Awa
Follow
Sep 26 '24
Data Engineering in Observability: The Backbone of Modern Monitoring
#
dataengineering
#
observability
#
opensource
#
banking
1
reaction
Comments
Add Comment
5 min read
Análise de dados de tráfego aéreo em tempo real com Spark Structured Streaming e Apache Kafka
Geazi Anc
Geazi Anc
Geazi Anc
Follow
Oct 28 '24
Análise de dados de tráfego aéreo em tempo real com Spark Structured Streaming e Apache Kafka
#
dataengineering
#
python
#
braziliandevs
#
spark
6
reactions
Comments
Add Comment
8 min read
Oracle to Snowflake Migration: Steps, Challenges & Best Practices
Sourabh Gupta
Sourabh Gupta
Sourabh Gupta
Follow
Oct 28 '24
Oracle to Snowflake Migration: Steps, Challenges & Best Practices
#
datascience
#
dataengineering
#
tutorial
#
learning
2
reactions
Comments
Add Comment
3 min read
Data Engineering in 2024: Innovations and Trends Shaping the Future
MissMati
MissMati
MissMati
Follow
Oct 27 '24
Data Engineering in 2024: Innovations and Trends Shaping the Future
#
dataengineering
#
data
#
analytics
8
reactions
Comments
2
comments
13 min read
My journey learning Apache Spark
Paulet Wairagu
Paulet Wairagu
Paulet Wairagu
Follow
Oct 26 '24
My journey learning Apache Spark
#
spark
#
sql
#
dataengineering
1
reaction
Comments
Add Comment
2 min read
AWS DATA ENGINEER - 101
Sajjad Rahman
Sajjad Rahman
Sajjad Rahman
Follow
Oct 24 '24
AWS DATA ENGINEER - 101
#
aws
#
dataengineering
#
awschallenge
#
awsbigdata
3
reactions
Comments
Add Comment
2 min read
The Journey From a CSV File to Apache Hive Table
Abdullah Haggag
Abdullah Haggag
Abdullah Haggag
Follow
Oct 24 '24
The Journey From a CSV File to Apache Hive Table
#
hadoop
#
hive
#
bigdata
#
dataengineering
2
reactions
Comments
Add Comment
6 min read
Achieving Clean and Scalable PySpark Code: A Guide to Avoiding Redundancy
Gustavo
Gustavo
Gustavo
Follow
Sep 19 '24
Achieving Clean and Scalable PySpark Code: A Guide to Avoiding Redundancy
#
pyspark
#
dataengineering
#
cleancode
#
python
Comments
Add Comment
5 min read
Capítulo 2 - Modelos de Datos y Lenguajes de Consulta
Pablo Arango Ramirez
Pablo Arango Ramirez
Pablo Arango Ramirez
Follow
Oct 22 '24
Capítulo 2 - Modelos de Datos y Lenguajes de Consulta
#
data
#
sql
#
nosql
#
dataengineering
2
reactions
Comments
Add Comment
7 min read
All About Parquet Part 05 - Compression Techniques in Parquet
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 05 - Compression Techniques in Parquet
#
database
#
datascience
#
dataengineering
11
reactions
Comments
Add Comment
5 min read
All About Parquet Part 01 - An Introduction
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 01 - An Introduction
#
database
#
dataengineering
2
reactions
Comments
Add Comment
4 min read
All About Parquet Part 02 - Parquet's Columnar Storage Model
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 02 - Parquet's Columnar Storage Model
#
database
#
datascience
#
dataengineering
2
reactions
Comments
Add Comment
4 min read
All About Parquet Part 09 - Parquet in Data Lake Architectures
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 09 - Parquet in Data Lake Architectures
#
data
#
database
#
datascience
#
dataengineering
1
reaction
Comments
Add Comment
5 min read
All About Parquet Part 10 - Performance Tuning and Best Practices with Parquet
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 10 - Performance Tuning and Best Practices with Parquet
#
database
#
datascience
#
dataengineering
11
reactions
Comments
Add Comment
6 min read
All About Parquet Part 04 - Schema Evolution in Parquet
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 04 - Schema Evolution in Parquet
#
database
#
datascience
#
dataengineering
4
reactions
Comments
1
comment
5 min read
All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns
#
database
#
datascience
#
dataengineering
3
reactions
Comments
Add Comment
5 min read
All About Parquet Part 06 - Encoding in Parquet | Optimizing for Storage
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 06 - Encoding in Parquet | Optimizing for Storage
#
database
#
datascience
#
dataengineering
3
reactions
Comments
Add Comment
6 min read
All About Parquet Part 08 - Reading and Writing Parquet Files in Python
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 08 - Reading and Writing Parquet Files in Python
#
database
#
datascience
#
dataengineering
#
data
18
reactions
Comments
Add Comment
5 min read
All About Parquet Part 07 - Metadata in Parquet | Improving Data Efficiency
Alex Merced
Alex Merced
Alex Merced
Follow
Oct 21 '24
All About Parquet Part 07 - Metadata in Parquet | Improving Data Efficiency
#
data
#
database
#
dataengineering
#
datascience
4
reactions
Comments
Add Comment
5 min read
From a Unified Bronze Layer to Multiple Silver Layers: Streamlining Data Transformation in Databricks Unity Catalog
prakhyatkarri
prakhyatkarri
prakhyatkarri
Follow
Oct 20 '24
From a Unified Bronze Layer to Multiple Silver Layers: Streamlining Data Transformation in Databricks Unity Catalog
#
databricks
#
unitycatalog
#
medallionarchitecture
#
dataengineering
2
reactions
Comments
Add Comment
5 min read
*Mastering Informatica Intelligent Cloud Services (IICS) for Cloud Data Integration*
Rodolfo Mendivil
Rodolfo Mendivil
Rodolfo Mendivil
Follow
Oct 18 '24
*Mastering Informatica Intelligent Cloud Services (IICS) for Cloud Data Integration*
#
iics
#
data
#
etl
#
dataengineering
1
reaction
Comments
Add Comment
3 min read
Data Engineering with Scala: Mastering Real-Time Data Processing with Apache Flink and Google Pub/Sub
Geazi Anc
Geazi Anc
Geazi Anc
Follow
Oct 18 '24
Data Engineering with Scala: Mastering Real-Time Data Processing with Apache Flink and Google Pub/Sub
#
dataengineering
#
scala
#
datascience
#
flink
7
reactions
Comments
Add Comment
15 min read
Clear Link Between DevSecOps and Data Engineering
Regnard Raquedan
Regnard Raquedan
Regnard Raquedan
Follow
Sep 13 '24
Clear Link Between DevSecOps and Data Engineering
#
dataengineering
#
devops
#
devsecops
#
cloud
Comments
Add Comment
1 min read
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account