Unable to read Delta table with deletion vectors

Use the cluster with Databricks Runtime 12.2 LTS - 15.3 to query all deletion-vector-enabled Delta tables.

Written by Ravivarma S

Last published at: September 12th, 2024

Problem

You receive an error when trying to read a Delta table. 

java.lang.RuntimeException: Unable to read this table because it requires reader table feature(s) that is unsupported by this version of Databricks: deletionVectors.

Cause

Delta tables with deletion vectors enabled can only be queried using clusters with Databricks Runtime 12.2 LTS - 15.3 (current). 

Note

If you create a new Delta table using the SQL warehouse (which has Databricks Runtime 14.3 LTS - 15.3 (current)), the table will be created with deletion vectors and hold the corresponding properties and policies.

 

Solution

Use the cluster with Databricks Runtime 12.2 LTS - 15.3 (current) to query all deletion-vector-enabled Delta tables. 

For more information on deletion vectors, including compatibility with Delta clients, please review the What are deletion vectors? (AWS | Azure | GCP) documentation.

If you are unable to change your Databricks Runtime version, you can temporarily disable the Auto-Enable Deletion Vectors in your workspace settings. 

Important

Databricks recommends using the deletion vector feature as it helps reduce transaction time for DELETE/UPDATE processing in Delta tables.