Cannot read Databricks objects stored in the DBFS root directory

Problem

An Access Denied error returns when you attempt to read Databricks objects stored in the DBFS root directory in blob storage from outside a Databricks cluster.

Cause

This is normal behavior for the DBFS root directory. Databricks stores objects like libraries and other temporary system files in the DBFS root directory. Databricks is the only user that can read these objects.

Solution

Databricks does not recommend using the root directory for storing any user files or objects. Instead, create a different blob storage directory and mount it to DBFS.