DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
From Theory to Evidence: Validating Shannon Entropy for Data Quality at Scale
anthony_etherealogic profile

From Theory to Evidence: Validating Shannon Entropy for Data Quality at Scale

#dataquality #databricks #dataengineering #opensource
Comments
7 min read
Rejected but Not Defeated: Continuing My Journey Toward AWS Community Builders
cardinal_seen profile

Rejected but Not Defeated: Continuing My Journey Toward AWS Community Builders

#dataengineering #database #dataanalytics #datascience
1
Comments
1 min read
What is Snowflake? A Beginner's Guide to the Cloud Data Warehouse Everyone's Talking About
neha_christina_1ac8651819 profile

What is Snowflake? A Beginner's Guide to the Cloud Data Warehouse Everyone's Talking About

#snowflake #dataengineering #sql #beginners
1
Comments
4 min read
Kafka Explained
hiral profile

Kafka Explained

#architecture #beginners #dataengineering #systemdesign
2
Comments
2 min read
Building a Real-Time Market Anomaly Dashboard with Vue3, Element Plus, and Java
sutantoongsemfin profile

Building a Real-Time Market Anomaly Dashboard with Vue3, Element Plus, and Java

#vue #java #dataengineering #finance
1
Comments
3 min read
#Connecting Power BI to SQL Databases: A Complete Guide
ngigi_nyawira_a938a3f3847 profile

#Connecting Power BI to SQL Databases: A Complete Guide

#datascience #dataengineering
2
Comments
4 min read
100 Spark Scenario Based Interview Questions and Answers
hannah_usmedynska profile

100 Spark Scenario Based Interview Questions and Answers

#career #data #dataengineering #interview
Comments
24 min read
Otimizando Escrita e Performance em Ambientes com Delta Lake, MinIO e Spark
francisco_jaimedasilva profile

Otimizando Escrita e Performance em Ambientes com Delta Lake, MinIO e Spark

#database #dataengineering #performance #tutorial
1
Comments
3 min read
Quantified Self: Syncing Whoop and Garmin Metrics with InfluxDB and Grafana
beck_moulton profile

Quantified Self: Syncing Whoop and Garmin Metrics with InfluxDB and Grafana

#python #opensource #quantifiedself #dataengineering
1
Comments
3 min read
Amazon S3 Files: from Kafka to S3 via NFS
dobeerman profile

Amazon S3 Files: from Kafka to S3 via NFS

#architecture #aws #dataengineering #tutorial
3
Comments 1
11 min read
16GB of RAM, 12GB of JSON, and One Very Loud Fan
velk profile
Velk

16GB of RAM, 12GB of JSON, and One Very Loud Fan

#python #postgres #dataengineering #seo
Comments
5 min read
How Apache Iceberg's Metadata Architecture Enables ACID at Scale
iprithv profile

How Apache Iceberg's Metadata Architecture Enables ACID at Scale

#architecture #database #dataengineering #distributedsystems
Comments
7 min read
Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines
airtruffle profile

Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines

#dataquality #airlinetechnology #traveldatapipelines #dataengineering
Comments
7 min read
The Modern Data Stack Has a Coherence Problem
hui_zhao_405dc49731688b0c profile

The Modern Data Stack Has a Coherence Problem

#dataengineering #ai #architecture #database
1
Comments
7 min read
How I built a MilliSeconds data quality firewall on Cloudflare Workers
appdeviq profile

How I built a MilliSeconds data quality firewall on Cloudflare Workers

#python #dataengineering #cloudflarechallenge #opensource
2
Comments 1
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.