Databricks Help Center

Main Navigation

  • Help Center
  • Documentation
  • Knowledge Base
  • Community
  • Training
  • Feedback

Delta Live Tables (Azure)

18 Articles in this category

  • Home
  • All articles
  • Delta Live Tables (Azure)

Cannot select a Databricks Runtime version when using a Delta Live Tables pipeline

Delta Live Tables do not allow you to directly configure the Databricks Runtime version....

Last updated: April 20th, 2023 by Jose Gonzalez

Delta Live Tables job fails when using collect()

You should not use functions such as collect(), count(), toPandas(), save(), and saveAsTable() within the table and view function definitions....

Last updated: May 10th, 2023 by Jose Gonzalez

Handling WARN Message: 'Could not turn on CDF for table (table-name)' in Delta Live Tables Pipeline

Exclude and then drop reserved columns. ...

Last updated: September 23rd, 2024 by gopinath.chandrasekaran

Handling Data Duplication Issues with Databricks Autoloader and Delta Lake using replaceWhere

Ensure that the replaceWhere option is applied during the write operation...

Last updated: September 12th, 2024 by Ravivarma S

Auto Loader does not pick up files for processing when uploading via an Azure function

Modify the code in the Azure function to add the 'CLOSE' parameter....

Last updated: August 30th, 2024 by potnuru.siva

Unclear how to control micro-batch size on a streaming table in Delta Live Tables (DLT)

Use the rate limiters along with the keyword LIVE....

Last updated: September 9th, 2024 by potnuru.siva

Vector search index does not sync or update, and gives error EXECUTION_SERVICE_STARTUP_FAILURE.STORAGE_PERMISSION_ISSUE

Update the Azure Storage firewall settings to allow Databricks serverless compute subnets. ...

Last updated: October 1st, 2024 by saikumar.divvela

DLT pipeline fails with error DLT ERROR CODE: EXECUTION_SERVICE_STARTUP_FAILURE

Use the dbutils.fs.refreshMounts() command in the DLT code. ...

Last updated: November 17th, 2024 by alberto.umana

Permissions issue when trying to access DLT-managed streaming tables and materialized views in Unity Catalog

Grant required Unity Catalog permissions and apply a compatible compute type. ...

Last updated: November 15th, 2024 by brock.baurer

applyInPandasWithState fails with a ModuleNotFoundError when used with Delta Live Tables

Define a function within the notebook instead of calling it directly....

Last updated: December 2nd, 2024 by mounika.tarigopula

The Written metric in Delta Live Tables does not match the number of rows in the target table

The Written metric includes all attempted writes in the DLT pipeline....

Last updated: January 16th, 2025 by Tarun Sanjeev

Command %run not working on Delta Live Table (DLT) pipelines

Use DLT's built-in features for code reuse and dependency management instead. ...

Last updated: January 22nd, 2025 by Jose Gonzalez

ANALYZE statement not working on Delta Live Tables (DLT)

Allow the built-in maintenance job to run instead of using ANALYZE....

Last updated: January 22nd, 2025 by Jose Gonzalez

Delta Live Tables (DLT) cluster keeps running after pipeline completes

Switch your DLT pipeline to production mode....

Last updated: January 31st, 2025 by mounika.tarigopula

Multiple tables created in a DLT pipeline using for loop have the same data/ schema of the last source table

Modify your code to pass the source table as an argument to the create_table function in the for loop....

Last updated: February 4th, 2025 by potnuru.siva

Cannot see how to change the owner of a DLT pipeline in the Databricks UI

Ask a user with both metastore and workspace admin privileges to change the owner in the UI....

Last updated: February 26th, 2025 by david.vega

Non-admin users with 'CAN MANAGE' permissions on a specific DLT cluster can see the Spark UI but cannot view the driver logs

Set spark.databricks.acl.needAdminPermissionToViewLogs to false....

Last updated: March 14th, 2025 by kingshuk.das

DLT pipeline failing with ConcurrentDeleteDeleteException error

Set the table property delta.enableRowTracking to true to enable row tracking on the table....

Last updated: April 25th, 2025 by manikandan.ganesan

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request. We’ll get back to you as soon as possible.

Please enter the details of your request. A member of our support staff will respond as soon as possible.


© Databricks 2022-2025. All rights reserved. Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation.

Send us feedback | Privacy Notice (Updated) | Terms of Use | Your Privacy Choices | Your California Privacy Rights Privacy Rights icon


Knowledge Base Software powered by Helpjuice

Definition by Author

0
0