Cannot import TabularPrediction from AutoGluon

Cannot import TabularPrediction from AutoGluon v0.0.14 due to a namespace collision. Upgrade to AutoGluon v0.0.15....

How to correctly update a Maven library in Databricks

Learn how to correctly update a Maven library in Databricks....

Init script fails to download Maven JAR

Cluster init script fails to download a Maven JAR when trying to install a library....

Install package using previous CRAN snapshot

Avoid a package install error by installing from an earlier CRAN snapshot....

Install PyGraphViz

Install PyGraphViz with all required dependencies....

Install Turbodbc via init script

Install Turbodbc and its dependencies, libboost-all-dev, unixodbc-dev, and python-dev, with an init script....

Cannot uninstall library from UI

Learn what to do when you can't uninstall a library using the Databricks user interface....

Error when installing Cartopy on a cluster

Cartopy installation fails if libgeos and libproj are not installed....

Error when installing pyodbc on a cluster

Learn how to troubleshoot an error when installing pyodbc on a Databricks cluster....

Libraries fail with dependency exception

Learn why notebook-scoped libraries trigger an Apache Spark dependency exception; return a requirement cannot be satisfied error....

Reading .xlsx files with xlrd fails

xlrd no longer supports .xlsx files. Use openpyxl to read .xlsx files....

Remove Log4j 1.x JMSAppender and SocketServer classes from classpath

Remove Log4j 1.x JMSAppender and SocketServer classes from classpath....

Python command fails with AssertionError: wrong color format

Resolve a wrong color format AssertionError caused by nbconvert when a Python command fails....

PyPMML fails with Could not find py4j jar error

...

TensorFlow fails to import

TensorFlow fails to import if you have an incompatible version of protobuf installed on your cluster....

Verify the version of Log4j on your cluster

Verify the version of Log4j installed on your cluster and upgrade if required....

Apache Spark jobs fail with Environment directory not found error

Spark jobs appear to time out after you install a library because security rules are preventing workers from resolving the Python executable path....

Copy installed libraries from one cluster to another

Copy libraries from a source cluster to a target cluster with a custom Python script....

Failed to install Elasticsearch via Maven

If library dependencies are already installed, it can result in a library installation failure....

Cluster fails to start with InvalidGroup.NotFound error

If the network security group policy is not correctly configured your clusters will fail to start....

Add libraries to a job cluster to reduce idle time

How to add libraries to a job cluster and reduce idle time in Databricks...

PyArrow hotfix breaking change

PyArrow versions 0.14 - 14.0.0 contain a security vulnerability....

OpenSSL SSL_connect: SSL_ERROR_SYSCALL error

Use a cluster-scoped init script to install necessary SSL certificates to resolve a SSL_ERROR_SYSCALL error....

Notebook cells fail to run with "Failure Starting repl." and Pandas "check_dependencies" errors

Ensure you do not have a dependency mismatch with the NumPy and/or Pandas versions installed on your cluster....

Virtualenv creation failure due to setuptools >= 71.0.0

Pin setuptools version 70.3.0....

Libraries failing with owner or network errors on Databricks Runtime 13.3 LTS - current (15.3)

Manually adjust your custom index URL. ...

Maven Libraries Start Failing with Timed-Out Errors When Updating to Databricks Runtime 11.3 LTS - 15.3 (current)

Whitelist Maven Central and the new Maven repo....

Paths behave differently on Git folders and workspace folders

Git folders can reference the project root, while workspace folders reference the current working directory....

GDAL library installation

Troubleshooting GDAL init script issues...

Installing lme4 fails with a Matrix version error

Upgrade the version of Matrix to 1.6.2 or above before installing lme4....

User not found error while trying to install a library on a shared cluster

Change cluster ownership and reconfigure all libraries under the new owner....

Init script to set up Dask library fails and cluster won’t start

Modify the initialization script to include a validation check for the required environment variables first....

Office365 library installation causes numpy.dtype size change error while executing notebook commands

Pin the Moviepy library version that uses the NumPy version compatible with your Databricks Runtime version....

Fixture not found error when using pytest on a cluster

Downgrade pytest to version 8.3.2 or upgrade Databricks Runtime to 16.1 or above....

Error when attempting to use 'stream_read_table' function from Sparklyr in 14.3 LTS ML

Install Sparklyr version 1.8.6 in the cluster's libraries, restart the cluster, and rerun the function to ensure the error is fixed....

Library installation attempted on the driver node of the cluster failed

Uninstall and reinstall the library. ...

Py4JJavaError when trying to install libraries on SSL-encrypted cluster

Set the Apache Spark configuration to disable SSL....

Unable to install R package 'Survminer' on cluster

Use an init script to install a compatible version of R and the necessary dependencies....

DLTImportException error when importing the DLT module

Use a cluster-scoped init script targeting the job or cell commands in a notebook. ...

ClassNotFoundException error when executing a job or notebook with a custom Kryo serializer

Use an init script or use the spark.jars property in your Apache spark configuration....

Error during Maven library installation: ERROR_MAVEN_LIBRARY_RESOLUTION

Install libraries separately, host a private Maven mirror, or if necessary use another Maven mirror....

Error when attempting to install torch for R package

Install the required dependencies before installing torch for R....

Getting ValueError when trying to import PMML files using PyPMML

Remove -XX:+PrintFlagsFinal flag from Java options....

Getting timeout error during Maven library installation on Databricks cluster

Configure your cluster to use private repos as the default repository, and disable the default Maven Central resolver and Apache Spark packages resolver....

Notebook or workflow fails with “Error : Py4JError: Could not find py4j jar at” error after trying to install PyPMML on a cluster

Install your Py4J library into the expected location....