DEV Community

# bigdata

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The future of Data Engineering in Databricks - From Pipelines to Intent
therectoverse profile

The future of Data Engineering in Databricks - From Pipelines to Intent

#dataengineering #databricks #ai #bigdata
1
Comments
2 min read
From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel
seatunnel profile

From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel

#apacheseatunnel #mongodb #opensource #bigdata
2
Comments
9 min read
(I) An Overview of Data Warehouses and Data Lakes
seatunnel profile

(I) An Overview of Data Warehouses and Data Lakes

#database #opensource #datascience #bigdata
2
Comments
4 min read
How to Size a Spark Cluster. And How Not To.
therectoverse profile

How to Size a Spark Cluster. And How Not To.

#spark #dataengineering #distributedsystems #bigdata
1
Comments
6 min read
build-my-own-datalake: Improve metadata with caching
kination profile

build-my-own-datalake: Improve metadata with caching

#bigdata #metadata #rust #buildmyownx
3
Comments
19 min read
Part 1 | A Scheduler Is More Than Just a “Timer”
chen_debra_3060b21d12b1b0 profile

Part 1 | A Scheduler Is More Than Just a “Timer”

#apachedolphinscheduler #opensource #programming #bigdata
Comments
4 min read
Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute
hello_arisyn_0dc948aa82b3 profile

Scaling Relationship Discovery Across 100,000+ Fields Without Breaking Compute

#scalablesystems #dataengineering #distributedsystems #bigdata
1
Comments 1
2 min read
How to Implement Data Modelling in Power BI
gathurum profile

How to Implement Data Modelling in Power BI

#dataengineering #datascience #bigdata #beginners
2
Comments
2 min read
Designing a Cross-Cloud Data Plane with Apache Iceberg
geekusa33 profile

Designing a Cross-Cloud Data Plane with Apache Iceberg

#dataengineering #gcp #aws #bigdata
2
Comments
5 min read
Arisyn: Rebuilding Data Relationship Discovery as Infrastructure
hello_arisyn_0dc948aa82b3 profile

Arisyn: Rebuilding Data Relationship Discovery as Infrastructure

#dataengineering #dataarchitecture #ai #bigdata
1
Comments 1
3 min read
How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me
nk2552003 profile

How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me

#datascience #opensource #learning #bigdata
2
Comments 1
3 min read
Fuzzy-match millions of rows in Databricks (2026)
siyana_hristova_900e581ee profile

Fuzzy-match millions of rows in Databricks (2026)

#datascience #dataengineering #databricks #bigdata
8
Comments
5 min read
Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB
apachedoris profile

Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB

#postgres #bigdata #database #doris
Comments
5 min read
Bigtable vs BigQuery: What’s the difference? (2026 Guide)
tech_croc_f32fbb6ea8ed4 profile

Bigtable vs BigQuery: What’s the difference? (2026 Guide)

#bigdata #googlecloud #programming #algorithms
5
Comments
4 min read
Apache Iceberg Explained: From Data Lakes to Metadata, Snapshots, and Real-World Usage
mohhddhassan profile

Apache Iceberg Explained: From Data Lakes to Metadata, Snapshots, and Real-World Usage

#datalake #apacheiceberg #dataengineering #bigdata
2
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.