Databricks Help Center

Main Navigation

  • Help Center
  • Documentation
  • Knowledge Base
  • Community
  • Training
  • Feedback

Cloud infrastructure

These articles can help you manage the configuration for your Databricks workspaces.

26 Articles in this category

  • Home
  • All articles
  • Cloud infrastructure

AWS services fail with No region provided error

AWS services fail with a Java "No region provided" error in Databricks Runtime 7.0 and above....

Last updated: July 20th, 2022 by arjun.kaimaparambilrajan

Troubleshooting Amazon Redshift connection problems

Learn how to troubleshoot Amazon Redshift connection problems....

Last updated: February 25th, 2022 by Adam Pavlacka

Vulnerability scan shows vulnerabilities in Databricks EC2 instances

Learn how to resolve vulnerabilities in long-running Databricks EC2 instances....

Last updated: February 25th, 2022 by Adam Pavlacka

Configure custom DNS settings using dnsmasq

Learn how to configure custom DNS settings using dnsmasq....

Last updated: May 10th, 2023 by brian.sears

Unable to load AWS credentials

...

Last updated: February 25th, 2022 by Adam Pavlacka

Access denied when writing logs to an S3 bucket

Learn how to resolve an access denied error while writing logs to an S3 bucket....

Last updated: February 25th, 2022 by Adam Pavlacka

S3 part number must be between 1 and 10000 inclusive

Learn how to resolve the S3 part number must be between 1 and 10000 inclusive error....

Last updated: July 22nd, 2022 by Adam Pavlacka

How to analyze user interface performance issues

Learn how to troubleshoot Databricks user interface performance issues....

Last updated: June 16th, 2022 by Adam Pavlacka

Unable to mount Azure Data Lake Storage Gen1 account

Learn how to resolve errors that occur when mounting Azure Data Lake Storage Gen1 to Databricks....

Last updated: February 25th, 2022 by Adam Pavlacka

Assign a single public IP for VNet-injected workspaces using Azure Firewall

Learn how to assign a single public IP address for a Databricks workspace in a virtual network using Azure Firewall....

Last updated: December 7th, 2022 by Adam Pavlacka

Network configuration of Azure Data Lake Storage Gen1 causes ADLException: Error getting info for file

Learn how to resolve credential passthrough failure when using Azure Data Lake Storage Gen1 with Databricks....

Last updated: December 7th, 2022 by Adam Pavlacka

Jobs are not progressing in the workspace

Learn how to troubleshoot a Databricks workspace in a virtual network using Azure Firewall. "WARN TaskSchedulerImpl Initial job has not accepted any resources" error message....

Last updated: December 7th, 2022 by Adam Pavlacka

SAS requires current ABFS client

SAS requires the current ABFS client; old clients generate an `IllegalArgumentException` error....

Last updated: December 7th, 2022 by kavya.parag

Setup cross account bucket access in Google Cloud

Use service accounts to grant access to storage buckets in another account....

Last updated: December 21st, 2022 by navya.athiraram

Azure container does not exist error when creating files in a workspace

Make sure the container location and permissions are correct....

Last updated: September 12th, 2024 by prabakar.ammeappin

Job fails with input/output error when displaying a data frame

Check your NSG and port settings. ...

Last updated: September 12th, 2024 by dayanand.devarapalli

Workspace creation failure when using Terraform

Check SCPs and make adjustments. ...

Last updated: August 28th, 2024 by pooja.s

Clusters terminating with error AWS_INSUFFICIENT_FREE_ADDRESSES_IN_SUBNET_FAILURE (CLIENT_ERROR)

Increase the size of your subnet to allow for more IP addresses or free up some of the IP addresses currently in use....

Last updated: September 27th, 2024 by Gihyeon Lee

Connection refused error when trying to connect to an external service from Databricks

Check your DNS resolution and port connectivity, report to your internal networking team, and then contact Databricks if the issue still persists....

Last updated: January 9th, 2025 by parth.sundarka

Unable to deploy clusters or warehouses due to a SECURITY_DAEMON_REGISTRATION_EXCEPTION error

Configure an STS interface endpoint on your VPC....

Last updated: January 14th, 2025 by julian.campabadal

Apache Spark driver failing with unexpected stop and restart message

Reduce the size of the objects being collected or processed in parallel. ...

Last updated: January 16th, 2025 by Guilherme Leite

Unable to create a workspace using Quickstart when IP access list is enabled for accounts console

Contact AWS Support for further assistance on IP ranges for allow listing or temporarily disable the Databricks account IP access list....

Last updated: January 31st, 2025 by aishwarya.sood

403 error when attempting to synchronize users through an Azure Databricks SCIM provisioning connector

Automate updating the Databricks IP access list using the Databricks Accounts API....

Last updated: March 3rd, 2025 by ankit.raj

Unexpected increase in S3 billing costs

Enable S3 debug logs to capture API calls made to the S3 bucket....

Last updated: March 3rd, 2025 by ajay.ap

S3 bucket storage keeps growing due to logs

You should not use DFBS root for logs. If you must, enable a lifecycle policy....

Last updated: April 7th, 2025 by kunal.jadhav

NAT gateway configuration issues with Azure Databricks workspace using VNET injection

Enable secure cluster connectivity on your workspace....

Last updated: April 26th, 2025 by vidya.sagamreddy

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request. We’ll get back to you as soon as possible.

Please enter the details of your request. A member of our support staff will respond as soon as possible.


© Databricks 2022-2025. All rights reserved. Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation.

Send us feedback | Privacy Notice (Updated) | Terms of Use | Your Privacy Choices | Your California Privacy Rights Privacy Rights icon


Knowledge Base Software powered by Helpjuice

Definition by Author

0
0