Databricks Help Center

Main Navigation

  • Help Center
  • Documentation
  • Knowledge Base
  • Community
  • Training
  • Feedback

Databricks SQL

These articles can help you with Databricks SQL.

36 Articles in this category

  • Home
  • All articles
  • Databricks SQL

Null column values display as NaN

Null column values correctly display as NaN in Databricks SQL....

Last updated: March 4th, 2022 by Adam Pavlacka

Retrieve queries owned by a disabled user

How to retrieve queries owned by a disabled user in Databricks SQL....

Last updated: March 4th, 2022 by John.Lourdu

Job timeout when connecting to a SQL endpoint over JDBC

Increase the SocketTimeout value in the JDBC connection URL to prevent thread requests from timing out....

Last updated: January 20th, 2023 by Atanu.Sarkar

Slowness when fetching results in Databricks SQL

Ensure that cloud fetch is enabled for best performance when using ODBC/JDBC to fetch results....

Last updated: February 3rd, 2023 by emad.rizkallah

ZORDER results in "Hilbert indexing can only be used on 9 or fewer columns" error

OPTIMIZE ZORDER BY command has a hard limit of nine columns....

Last updated: March 15th, 2023 by emad.rizkallah

Cannot customize Apache Spark config in Databricks SQL warehouse

You can only configure a limited set of global Spark properties when using a SQL warehouse....

Last updated: March 15th, 2023 by mounika.tarigopula

SQL warehouse launch fails to start with "PERMISSION_DENIED"

Ensure the necessary permissions are provided to the SQL warehouse owner...

Last updated: January 30th, 2024 by rohit.menon

Update the Databricks SQL warehouse owner

Learn how to use the API to transfer ownership of a SQL warehouse to a new owner...

Last updated: February 29th, 2024 by simran.arora

Unable to use dynamic variable passing to create a function in Databricks SQL Warehouse

Use a Python UDF in a notebook to dynamically pass the table name as a variable, then access the function in a notebook or DBSQL. ...

Last updated: September 23rd, 2024 by shanmugavel.chandrakasu

Databricks SQL ANSI enablement guide

Learn how to enable ANSI SQL for your existing Databricks workloads....

Last updated: December 6th, 2024 by Adam Pavlacka

Error running parameterized SQL queries in Databricks Connect with VS Code

Pass the SQL parameter in Databricks Connect using string interpolation. ...

Last updated: November 22nd, 2024 by manoj.hegde

spark.rpc.message.maxSize error after running DESCRIBE HISTORY in SQL warehouse

You must limit or prune the query when using DESCRIBE HISTORY on large history logs....

Last updated: December 6th, 2024 by MuthuLakshmi.AN

DeltaInvariantViolationException: Exceeds char/varchar type length limitation error when writing a Delta table

...

Last updated: December 11th, 2024 by Vidhi Khaitan

Redshift queries using Lakehouse Federation taking longer than expected

Make JDBC fetchsize adjustments or use the COPY UNLOAD method....

Last updated: December 19th, 2024 by nelavelli.durganagajahnavi

PySparkAssertionError: Received incorrect server side session identifier for request

You must detach and reattach to reset the state....

Last updated: December 23rd, 2024 by vinay.mr

Error 'View/Table Does Not Exist' during model or query runtime in SQL Analytics

Use the command ALTER VIEW to update the view definition....

Last updated: January 10th, 2025 by wanderson.oliveira

Unable to read external Hive Metastore tables on SQL warehouses

Manually set the appropriate Apache Spark configurations in your admin settings for SQL warehouses....

Last updated: January 20th, 2025 by parth.sundarka

Using percentile() to work with large datasets causing memory issues or OOM errors

Use approx_percentile() instead. ...

Last updated: January 25th, 2025 by Raphael Freixo

Databricks SQL Warehouse query finish with cache is not populating ‘open in Spark UI’ option

When a query uses 100% of the cache, there are no corresponding Spark jobs or stages to display in Spark UI....

Last updated: January 31st, 2025 by Rajeev kannan Thangaiah

Jobs in SQL Warehouse returning 403 error

Modify the service account permissions, regenerate the token, and verify permissions are set....

Last updated: January 31st, 2025 by katherine.delgado

Serverless query still running after canceling

Run the CANCEL command and configure a query timeout....

Last updated: January 31st, 2025 by katherine.delgado

Photon ran out of memory while executing query

Ensure up-to-date statistics on all tables, simplify complex queries, or use Databricks Runtime 13.3 LTS or above. ...

Last updated: February 7th, 2025 by Jose Gonzalez

‘Query timeout due to inactivity’ error when using the SQL execution API

Obtain a statement ID from the pending POST API call and make a GET API call instead. ...

Last updated: February 7th, 2025 by sudeep.maskebail

Executing DROP field inside a nested column gives an INVALID_FIELD_NAME error

Use Databricks Runtime 13.3 LTS to execute. ...

Last updated: February 19th, 2025 by MuthuLakshmi.AN

ORC tables not recognized when processed in serverless warehouses

Recreate the ORC table as an Apache Spark format ORC table with "USING ORC" instead....

Last updated: February 20th, 2025 by John Benninghoff

Filtering data with char(255) datatype column does not retrieve a result

Remove the blank space from the right side of the column, cast the column name as a string type, or upgrade to Databricks Runtime 15.4 LTS or above. ...

Last updated: March 11th, 2025 by shubham.bhusate

COPY INTO not loading new data to destination table

Use the ‘force’ = ‘true’ option in COPY_OPTIONS....

Last updated: March 12th, 2025 by alberto.umana

Changing ANSI mode inline doesn’t work when querying a view

Recreate the view with the ANSI mode you need, or use try_cast, try_add, or try_divide in query operations that are not ANSI compliant. ...

Last updated: March 19th, 2025 by brock.baurer

Using double quotes in a query causes a syntax error

Enable the doubleQuotedIdentifiers setting in your Spark configuration and set spark.sql.ansi.enabled to true....

Last updated: March 19th, 2025 by raul.goncalves

New columns added to a table are not reflecting in a view

Rebuild the existing view or recreate the view using WITH SCHEMA EVOLUTION....

Last updated: March 19th, 2025 by brock.baurer

Not receiving emails from DBSQL alerts

Unblock noreply@databricks.com email from block list....

Last updated: April 2nd, 2025 by parth.sundarka

Error [DELTA_MERGE_INCOMPATIBLE_DECIMAL_TYPE] when performing a merge operation in Databricks Runtime 14.3 LTS or above

Set spark.sql.legacy.decimal.retainFractionDigitsOnTruncate to true or use the cast function to explicitly cast the columns to a specific decimal type....

Last updated: April 3rd, 2025 by nelavelli.durganagajahnavi

Find long running queries in your SQL warehouse

Use the query history feature....

Last updated: April 17th, 2025 by kunal.jadhav

Creating a temporary view inside a function returns an [INVALID_TEMP_OBJ_REFERENCE] error

Make the function temporary so both the function and the temporary view have the same lifespan and session scope....

Last updated: April 28th, 2025 by Raghavan Vaidhyaraman

You want to declare temporary variables inside a function in Databricks SQL

Use CTEs to declare temporary variables....

Last updated: April 28th, 2025 by Raghavan Vaidhyaraman

Query using COPY INTO using a direct file directory pattern fails with “ERROR: Job aborted due to stage failure” OOM error

Use INSERT INTO with read_files() instead....

Last updated: April 30th, 2025 by Amruth Ashoka

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request. We’ll get back to you as soon as possible.

Please enter the details of your request. A member of our support staff will respond as soon as possible.


© Databricks 2022-2025. All rights reserved. Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation.

Send us feedback | Privacy Notice (Updated) | Terms of Use | Your Privacy Choices | Your California Privacy Rights Privacy Rights icon


Knowledge Base Software powered by Helpjuice

Definition by Author

0
0