Databricks - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Aniket Abhishek Soni

Nov 5

Your MERGE statements are scanning too much data

#deltalake #spark #performance #databricks

4 min read

Renjith Ravindranathan

Nov 5

Building a Configuration-Driven Databricks Platform on AWS (Part 2)

#databricks #aws #github #cicd

9 min read

Gabriel Henrique

Nov 9

Databricks Real-Time Mode Is GA. Your Pipeline Still Won't Be Real-Time.

#databricks #dataengineering #azure #streaming

7 min read

Nov 9

Call Databricks Genie from C# with LakeSpeak

#dotnet #csharp #databricks #opensource

4 min read

Nov 9

Resolve tenant membership before a Databricks SQL call

#dotnet #csharp #databricks #opensource

4 min read

Aniket Abhishek Soni

Nov 2

Photon is not a magic speed button for every Spark query

#databricks #pyspark #spark #performance

5 min read

Pranjul Chaurasiya

Oct 31

Bridging the Lakehouse: Ingesting Databricks Unity Catalog into Cognee Knowledge Graphs

#databricks #ai #dataengineering #python

4 min read

Oct 29

Delta Lake Change Data Feed on Azure Databricks: readChangeFeed, Incremental MERGE, and the Retention Traps

#databricks #deltalake #pyspark #dataengineering

5 min read

Oct 28

Spark JDBC Parallel Reads on Azure Databricks: partitionColumn, Bounds, Predicates, and Not Knocking Over Your Database

#databricks #pyspark #spark #dataengineering

5 min read

Oct 26

Repartition vs Coalesce vs partitionBy on Azure Databricks: Controlling Output Files When Writing Delta Tables

#databricks #pyspark #spark #dataengineering

6 min read

Oct 27

Databricks co‑founder reveals how to win big‑enterprise customers

#databricks #enterprisesales #techcrunch

3 min read

AI Data Legends

Oct 26

Databricks Lakehouse Platform for Real-Time, Agentic Data and AI Workloads

#aiagents #dataengineering #databricks #lakehouse

3 min read

AI Data Legends

Oct 26

Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale

#dataengineering #databricks #lakehouse #sql

4 min read

Charan Reddy Rachumalla

Oct 26

Tiered Storage in Apache Kafka — Hot Data on Disk, Old Data in S3 (and the Same Trick That Cuts a Databricks Bill)

#kafka #dataengineering #databricks #kubernetes

8 min read

Oct 25

PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts

#databricks #pyspark #spark #dataengineering

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.