Problem

Job fails because libraries cannot be installed.

Library resolution failed. Cause: java.lang.RuntimeException: Cannot download some libraries due to transient Maven issue. Please try again later

Cause

After a Databricks upgrade, your cluster attempts to download any required libraries from Maven. After downloading, the libraries are stored as Workspace libraries. The next time you run a cluster that requires the libraries, they are loaded as Workspace libraries.

This behavior is due to legacy code.

Solution

There is no workaround for this issue.

This only happens after a maintenance window, and only if Maven is unavailable at the time. It is a rare corner case.