Start Here
Search & Browse the Databricks Knowledge Base.Help Topics
Whether it's a very specific question, or a vague one, we have it covered in our knowledge base.
Popular Articles
Unexpected cluster termination
Sometimes a cluster is terminated unexpectedly, not as a result of a manual termi...
SSO server redirects to original URL, not to vanity Databricks URL
Problem When you log into Databricks using a vanity URL (such as mycompany.cloud....
Spark job fails with Driver is temporarily unavailable
Problem When running notebooks or jobs on a cluster, they run successfully multip...
How to improve performance of Delta Lake MERGE INTO queries using partition pruning
This article explains how to trigger partition pruning in Delta Lake MERGE INTO (...
Job failure due to Azure Data Lake Storage (ADLS) CREATE limits
Problem When you run a job that involves creating files in Azure Data Lake Storag...
How to improve performance with bucketing
Bucketing is an optimization technique in Apache Spark SQL. Data is allocated amo...
ABFS client hangs if incorrect client ID or wrong path used
Problem You are using Azure Data Lake Storage (ADLS) Gen2. When you try to access...
Append to a DataFrame
To append to a DataFrame, use the union method. %scala val firstDF = spark.range(...
Apache Spark job fails with Parquet column cannot be converted error
Problem You are reading data in Parquet format and writing to a Delta table when ...
How to handle blob data contained in an XML file
If you log events in XML format, then every XML event is recorded as a base64 str...