Unable to read Delta table with deletion vectors

Use the cluster with Databricks Runtime 12.2 LTS - 15.3 to query all deletion-vector-enabled Delta tables.

Written by Ravivarma S

Last published at: September 12th, 2024

Problem

You receive an error when trying to read a Delta table. 

java.lang.RuntimeException: Unable to read this table because it requires reader table feature(s) that is unsupported by this version of Databricks: deletionVectors.

Cause

Delta tables with deletion vectors enabled can only be queried using clusters with Databricks Runtime 12.2 LTS - 15.3 (current). 

Note

If you create a new Delta table using the SQL warehouse (which has Databricks Runtime 14.3 LTS - 15.3 (current)), the table will be created with deletion vectors and hold the corresponding properties and policies.

 

Solution

Use the cluster with Databricks Runtime 12.2 LTS - 15.3 (current) to query all deletion-vector-enabled Delta tables. 

For more information on deletion vectors, including compatibility with Delta clients, please review the What are deletion vectors? (AWSAzureGCP) documentation.

If you are unable to change your Databricks Runtime version, you can temporarily disable the Auto-Enable Deletion Vectors in your workspace settings. 

Important

Databricks recommends using the deletion vector feature as it helps reduce transaction time for DELETE/UPDATE processing in Delta tables. 

 

 

Was this article helpful?