DEV Community

# bigdata

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
🚀 Apache Spark Just Killed the Microbatch Barrier (And Why Flink Should Be Worried)
siddhesh_surve profile

🚀 Apache Spark Just Killed the Microbatch Barrier (And Why Flink Should Be Worried)

#dataengineering #apachespark #bigdata #cloudcomputing
1
Comments
3 min read
Building a Transport Monitoring Dashboard with APIs đźššđź“Š
goutam_kumar_25db122cf377 profile

Building a Transport Monitoring Dashboard with APIs đźššđź“Š

#realtime #firebase #bigdata #googlecloud
1
Comments
7 min read
Apache Cloudberry 2.0: Rebuilding Storage for the Cloud-Native Era with PAX
maya_sun_29e7bf629e5dd7b3 profile

Apache Cloudberry 2.0: Rebuilding Storage for the Cloud-Native Era with PAX

#apachecloudberry #bigdata
1
Comments
6 min read
How to Choose Between Serverless and Dedicated Compute in Databricks
therectoverse profile

How to Choose Between Serverless and Dedicated Compute in Databricks

#serverless #databricks #distributedsystems #bigdata
3
Comments
3 min read
Orchestrating Our Way Out of Chaos: How I Compared Airflow, Prefect, and Dagster (and Picked What to Ship)
isha_vason profile

Orchestrating Our Way Out of Chaos: How I Compared Airflow, Prefect, and Dagster (and Picked What to Ship)

#bigdata #elt #airflow #dagster
2
Comments
6 min read
Part 3 | How Does Scheduling Actually “Start Running”?
chen_debra_3060b21d12b1b0 profile

Part 3 | How Does Scheduling Actually “Start Running”?

#apachedolphinscheduler #opensource #bigdata #datascience
4
Comments
5 min read
How to Implement Data Modelling in Power BI
gathurum profile

How to Implement Data Modelling in Power BI

#dataengineering #datascience #bigdata #beginners
2
Comments
2 min read
The future of Data Engineering in Databricks - From Pipelines to Intent
therectoverse profile

The future of Data Engineering in Databricks - From Pipelines to Intent

#dataengineering #databricks #ai #bigdata
2
Comments
2 min read
Designing a Cross-Cloud Data Plane with Apache Iceberg
geekusa33 profile

Designing a Cross-Cloud Data Plane with Apache Iceberg

#dataengineering #gcp #aws #bigdata
2
Comments
5 min read
How to Size a Spark Cluster. And How Not To.
therectoverse profile

How to Size a Spark Cluster. And How Not To.

#spark #dataengineering #distributedsystems #bigdata
2
Comments
6 min read
Arisyn: Rebuilding Data Relationship Discovery as Infrastructure
hello_arisyn_0dc948aa82b3 profile

Arisyn: Rebuilding Data Relationship Discovery as Infrastructure

#dataengineering #dataarchitecture #ai #bigdata
1
Comments 1
3 min read
How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me
nk2552003 profile

How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me

#datascience #opensource #learning #bigdata
2
Comments 1
3 min read
build-my-own-datalake: Improve metadata with caching
kination profile

build-my-own-datalake: Improve metadata with caching

#bigdata #metadata #rust #buildmyownx
4
Comments
19 min read
From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel
seatunnel profile

From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel

#apacheseatunnel #mongodb #opensource #bigdata
4
Comments
9 min read
(I) An Overview of Data Warehouses and Data Lakes
seatunnel profile

(I) An Overview of Data Warehouses and Data Lakes

#database #opensource #datascience #bigdata
3
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.