Job fails because libraries cannot be installed.
Library resolution failed. Cause: java.lang.RuntimeException: Cannot download some libraries due to transient Maven issue. Please try again later
After a Databricks upgrade, your cluster attempts to download any required libraries from Maven. After downloading, the libraries are stored as Workspace libraries. The next time you run a cluster that requires the libraries, they are loaded as Workspace libraries.
This behavior is due to legacy code.
There is no workaround for this issue.
This only happens after a maintenance window, and only if Maven is unavailable at the time. It is a rare corner case.