Apache Spark session is null in DBConnect

A `sparkSession is null while trying to executeCollectResult` error message occurs when using DBConnect....

Databricks Connect reports version error with Databricks Runtime 6.4

...

Failed to create process error with Databricks CLI in Windows

Databricks CLI may not work correctly in Windows if your Python path has a space in it....

GeoSpark undefined function error with DBConnect

Use GeoSpark code with a DBConnect session....

Get Apache Spark config in DBConnect

Use a REST API call and DBConnect to get the Apache Spark configuration for your cluster....

How to Sort S3 files By Modification Time in Databricks Notebooks

...

Invalid Access Token error when running jobs with Airflow

Learn what to do when you receive an Invalid Access Token error when using Databricks jobs with Airflow....

ProtoSerializer stack overflow error in DBConnect

A stack overflow error in DBConnect indicates that you need to allocate more memory on the local PC....

Use tcpdump to create pcap files

Analyze network traffic between nodes on a specific cluster by using tcpdump to create pcap files....

Common errors using Azure Data Factory

Learn about solutions and explanations for common errors when using Azure Data Factory with Azure Databricks....

Databricks Connect job fails after a Databricks Runtime update

Use the most recent version of Databricks Connect that matches your Databricks Runtime version to avoid an error....

Databricks-sql-python package fails with self-signed certificate errors and code _ssl.c:1006

Make sure your certificate is valid and updated....

Paths behave differently on Git folders and workspace folders

Git folders can reference the project root, while workspace folders reference the current working directory....

AWS Lambda multiprocessing.ThreadPool function issue when using db-connect 14 and 15 in Databricks

Use db-connect 16 in Databricks....

Content size error when trying to import or export a notebook

Reduce the size of your notebook so it is under 10MB....

Missing TRACE level Terraform log files to troubleshoot template issue

Learn how to enable Terraform log files....

Deploying Databricks Asset Bundles through a CICD pipeline fails with 403 error

Configure the .gitignore file in your GitLab repository to exclude unnecessary hidden directories from the Asset Bundle deployment....

Jobs deployed using Databricks Asset Bundles show RUNNING in the terminal but then seem to hang indefinitely

Use the --no-wait flag with the databricks bundle run command....

Databricks API call to GitHub failing with 403 Forbidden error

Disable the IP allow list in GitHub....

Jobs using Apache Spark 3.5.1 and the Elasticsearch Hadoop connector failing with MicroBatchExecution error

Contact the Elastic team for assistance, or use Databricks Runtime 13.3 LTS and below....

PARSE_SYNTAX_ERROR error when using ODBC driver and MS PolyBase to execute queries in Databricks

Contact the Microsoft support team to access your ODBC driver logs and then for assistance correcting the error....

Connection timeout error when trying to connect to Snowflake from Databricks environments

Set up and run SnowCD to diagnose and troubleshoot....

Can’t find where to set email notifications for DAB jobs in the UI

Use YAML syntax to set the notifications....

“Cannot create grants” Terraform error when using multiple databricks_grants blocks for the same catalog

Use dynamic blocks within a single databricks_grants resource or use databricks_grant for ad-hoc permission assignment from Terraform. ...

Databricks Apps - Spark Context initialization fails with Java gateway error

Use the Databricks SQL Connector for Python to query tables in Databricks Apps....

Special characters appearing as junk characters when using the Simba Spark ODBC driver to access Databricks tables from external applications

Set the SIMBA_APP_ANSI_ENCODING environment variable to ISO-8859-15....

Experiencing an exception indicating “ Yaml file exists as” referring to meta.yaml file when creating an MLflow experiment

Add mlflow.set_tracking_uri("databricks") to your code or remove the meta.yaml file referenced in the exception....

How to create an init script to collect tcp_dumps on a standard (formerly shared) access mode cluster

Modify previously published instructions to use a volume path and add a step to add the init script to an allowlist....

Unable to push GitHub Actions workflows from a Databricks repository

Use a Github PAT token with workflow scope....