DEV Community

Discussion on: Streaming Data in Databricks Delta Tables

Collapse
parathkumar_sabesan_5e6b profile image
Parath kumar Sabesan

Hi Will,

When I try to write a streaming data to a partitioned managed delta table it's not loading data into it and also it's not showing any error,

but the same thing working fine with non partitioned managed delta table
what I'm missing here ??
dfWrite.writeStream\

.partitionBy("submitted_yyyy_mm")\

.format("delta")\

.outputMode("append")\

.queryName("orders")\

.option("checkpointLocation", orders_checkpoint_path)\

.table(user_db+"."+orders_table)