Unable to read Delta table with deletion vectors

Problem You receive an error when trying to read a Delta table.  java.lang.RuntimeException: Unable to read this table because it requires reader table feature(s) that is unsupported by this version of Databricks: deletionVectors. Cause Delta tables with deletion vectors enabled can only be queried using clusters with Databricks Runtime 12.2 LTS - 1...

0 min reading time

Handling Data Duplication Issues with Databricks Autoloader and Delta Lake using replaceWhere

Problem  When using  replaceWhere   during data ingestion to overwrite specific data partitions in a Delta table, you notice that new data are appended to, instead of replacing, old data, causing duplicates.  Cause The  replaceWhere option is intended to be used during the write operation, not the read operation. When used during the read operation,...

0 min reading time