DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Understanding RAID Levels: A Comprehensive Guide to RAID 0, 1, 5, 6, 10, and Beyond
pltnvs profile

Understanding RAID Levels: A Comprehensive Guide to RAID 0, 1, 5, 6, 10, and Beyond

#dataengineering #softwareraid #dataredundancy #datastorage
8
Comments
9 min read
BigQuery Schema Generation Made Easier with PyPI’s bigquery-schema-generator
noela_tenku profile

BigQuery Schema Generation Made Easier with PyPI’s bigquery-schema-generator

#data #dataengineering #bigquery #python
5
Comments 2
2 min read
Embrace simple tech stacks and code generation in DevOps and data engineering
panasenco profile

Embrace simple tech stacks and code generation in DevOps and data engineering

#devops #dataengineering #sitereliabilityengineering #operations
2
Comments
6 min read
MapReduce Vs Tez
shvshydv profile

MapReduce Vs Tez

#hadoop #dataengineering #database #datascience
6
Comments
2 min read
Azure Synapse Analytics Security: Data Protection
ayush9892 profile

Azure Synapse Analytics Security: Data Protection

#azure #sqlserver #dataengineering
3
Comments
6 min read
Leveraging PySpark.Pandas for Efficient Data Pipelines
felipe_de_godoy profile

Leveraging PySpark.Pandas for Efficient Data Pipelines

#dataengineering #spark #pandas #python
Comments
3 min read
Why Apache Doris is the Best Open Source Alternative to Rockset
apachedoris profile

Why Apache Doris is the Best Open Source Alternative to Rockset

#database #bigdata #dataengineering #openai
3
Comments
3 min read
Apache Spark-Structured Streaming :: Cab Aggregator Use-case
datasosneh profile

Apache Spark-Structured Streaming :: Cab Aggregator Use-case

#apachespark #dataengineering #streaming #realtimedata
1
Comments
4 min read
Introduction to Apache Hadoop & MapReduce
shvshydv profile

Introduction to Apache Hadoop & MapReduce

#hadoop #dataengineering #bigdata #datascience
5
Comments
3 min read
Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka
kination profile

Analytics don't want duplicated data, so get it exactly-once with Flink/Kafka

#flink #kafka #dataengineering
Comments
3 min read
Metadata for win — Apache Parquet
rahuldubey391 profile

Metadata for win — Apache Parquet

#python #bigdata #datascience #dataengineering
Comments
5 min read
Remove unwanted partition data in Azure Synapse (SQL DW)
ayush9892 profile

Remove unwanted partition data in Azure Synapse (SQL DW)

#dataengineering #sqlserver #azure
1
Comments
6 min read
Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu
aman_gupta_7c59c96e9e167a profile

Replacing Saas ETL with Python dlt: A painless experience for Yummy.eu

#saasetl #dataengineering #python
2
Comments
3 min read
Simplifying SDMX Data Integration with Python
aman_gupta_7c59c96e9e167a profile

Simplifying SDMX Data Integration with Python

#dataengineering #pipeline #etl #sdmx
2
Comments
3 min read
Clustering vs Partitioning your Apache Iceberg Tables
alexmercedcoder profile

Clustering vs Partitioning your Apache Iceberg Tables

#database #datascience #dataengineering #data
7
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.