DEV Community

#bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency
dinhphu2k1gif profile

How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency

#bigdata #dataengineering #apachehudi #architecture
Comments
9 min read
Your warehouse isn't expensive. Your full table scans are.
fagundesv profile

Your warehouse isn't expensive. Your full table scans are.

#bigdata #bigquery #redshift #aws
1
Comments 1
5 min read
Migrating a ScyllaDB Cluster the “Brain Transplant” Way
sadoyan profile
Ara

Migrating a ScyllaDB Cluster the “Brain Transplant” Way

#scylladb #bigdata #database
Comments
6 min read
"We Have DevOps, So Why Not DataOps?"
sezin_oztekin profile

"We Have DevOps, So Why Not DataOps?"

#datascience #bigdata #dataops #devops
Comments
2 min read
Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5
zasukhin profile
Ruslan

Valentina Studio v17.3 supports new VARIANT field type of DuckDB v1.5

#duckdb #valentinastudio #bigdata #database
Comments
1 min read
Why Big Tech is Migrating from Traditional Databases to NewSQL
dinhphu2k1gif profile

Why Big Tech is Migrating from Traditional Databases to NewSQL

#bigdata #dataengineering #database #sql
1
Comments
1 min read
The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases
manishpodiyal profile

The Data Refinery: Why Apache Spark is the Engine Behind Real-World Big Data Use Cases

#bigdata #spark #pyspark #dataengineering
Comments
2 min read
The Future of Query Optimization: AI-Driven Insights in Big Data
fuadhusnan_f44f3e13 profile

The Future of Query Optimization: AI-Driven Insights in Big Data

#bigdata #database #ai
Comments
7 min read
The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness
seatunnel profile

The Next Decade of Data Engineering: From Modern Data Stack to Data Engineering Harness

#data #dataengineering #dataengineeringharness #bigdata
Comments 1
8 min read
Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun
wilians_conde_6d4bbc5eed2 profile

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

#dataengineering #mongodb #systemdesign #bigdata
Comments
3 min read
Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic
stiiwann_35eb8bb2cf8dc53e profile

Fentanyl Poverty: Building a Big Data Pipeline to Map America's Overdose Epidemic

#bigdata #elasticsearch #spark #python
5
Comments 4
3 min read
Infrastructure Design for Credit Risk Modeling
marysofteng profile

Infrastructure Design for Credit Risk Modeling

#scorecard #analytics #bigdata #machinelearning
Comments
1 min read
CONNECTING POSTGRESQL WITH POWERBI (FOR A LOAN PERFORMANCE DASHBOARD)
john_analytics profile

CONNECTING POSTGRESQL WITH POWERBI (FOR A LOAN PERFORMANCE DASHBOARD)

#data #postgres #postgressql #bigdata
1
Comments
4 min read
B-Trees, Clustered Indexes, and the OLAP Revolution (Part 2) 📊
piyush6348 profile

B-Trees, Clustered Indexes, and the OLAP Revolution (Part 2) 📊

#database #sql #bigdata #systemdesign
Comments
3 min read
Mastering Schema Evolution: Why Apache Avro is the King of Big Data (Part 2)
piyush6348 profile

Mastering Schema Evolution: Why Apache Avro is the King of Big Data (Part 2)

#bigdata #architecture #kafka #programming
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.