DEV Community

# bigdata

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)
siyana_hristova_900e581ee profile

How to fuzzy-match 1M rows with dbt in under 10 minutes (2026 guide)

#dbt #bigquery #bigdata #dataengineering
Comments 1
4 min read
How to Choose Between Serverless and Dedicated Compute in Databricks
therectoverse profile

How to Choose Between Serverless and Dedicated Compute in Databricks

#serverless #databricks #distributedsystems #bigdata
3
Comments
3 min read
Orchestrating Our Way Out of Chaos: How I Compared Airflow, Prefect, and Dagster (and Picked What to Ship)
isha_vason profile

Orchestrating Our Way Out of Chaos: How I Compared Airflow, Prefect, and Dagster (and Picked What to Ship)

#bigdata #elt #airflow #dagster
2
Comments
6 min read
Part 3 | How Does Scheduling Actually “Start Running”?
chen_debra_3060b21d12b1b0 profile

Part 3 | How Does Scheduling Actually “Start Running”?

#apachedolphinscheduler #opensource #bigdata #datascience
4
Comments
5 min read
How to Implement Data Modelling in Power BI
gathurum profile

How to Implement Data Modelling in Power BI

#dataengineering #datascience #bigdata #beginners
2
Comments
2 min read
The future of Data Engineering in Databricks - From Pipelines to Intent
therectoverse profile

The future of Data Engineering in Databricks - From Pipelines to Intent

#dataengineering #databricks #ai #bigdata
2
Comments
2 min read
Designing a Cross-Cloud Data Plane with Apache Iceberg
geekusa33 profile

Designing a Cross-Cloud Data Plane with Apache Iceberg

#dataengineering #gcp #aws #bigdata
2
Comments
5 min read
How to Size a Spark Cluster. And How Not To.
therectoverse profile

How to Size a Spark Cluster. And How Not To.

#spark #dataengineering #distributedsystems #bigdata
2
Comments
6 min read
How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me
nk2552003 profile

How I Built a Big Data Survival Guide - Because My Semester Was Not Surviving Me

#datascience #opensource #learning #bigdata
2
Comments 1
3 min read
build-my-own-datalake: Improve metadata with caching
kination profile

build-my-own-datalake: Improve metadata with caching

#bigdata #metadata #rust #buildmyownx
4
Comments
19 min read
From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel
seatunnel profile

From TB-Scale MongoDB to Doris: 5 Critical Challenges and Fixes with Apache SeaTunnel

#apacheseatunnel #mongodb #opensource #bigdata
4
Comments
9 min read
(I) An Overview of Data Warehouses and Data Lakes
seatunnel profile

(I) An Overview of Data Warehouses and Data Lakes

#database #opensource #datascience #bigdata
3
Comments
4 min read
Fuzzy-match millions of rows in Databricks (2026)
siyana_hristova_900e581ee profile

Fuzzy-match millions of rows in Databricks (2026)

#datascience #dataengineering #databricks #bigdata
9
Comments
5 min read
Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB
apachedoris profile

Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB

#postgres #bigdata #database #doris
Comments
5 min read
Bigtable vs BigQuery: What’s the difference? (2026 Guide)
tech_croc_f32fbb6ea8ed4 profile

Bigtable vs BigQuery: What’s the difference? (2026 Guide)

#bigdata #googlecloud #programming #algorithms
5
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.