Problem
When you try to access secrets using an instance profile with a shared access mode cluster, you encounter the following error message.
NoCredentialsError: Unable to locate credentials
Cause
Accessing secrets using an instance profile is not supported in shared access mode, in order to prevent unauthorized access to sensitive information.
Solution
Use a single-user access mode cluster instead.
For more information, review the Compute access mode limitations for Unity Catalog (AWS | Azure | GCP)