Cannot select a Databricks Runtime version when using a Delta Live Tables pipeline

Delta Live Tables do not allow you to directly configure the Databricks Runtime version....

Delta Live Tables job fails when using collect()

You should not use functions such as collect(), count(), toPandas(), save(), and saveAsTable() within the table and view function definitions....

Handling WARN Message: 'Could not turn on CDF for table (table-name)' in Delta Live Tables Pipeline

Exclude and then drop reserved columns. ...

Handling Data Duplication Issues with Databricks Autoloader and Delta Lake using replaceWhere

Ensure that the replaceWhere option is applied during the write operation...

Auto Loader does not pick up files for processing when uploading via an Azure function

Modify the code in the Azure function to add the 'CLOSE' parameter....

Unclear how to control micro-batch size on a streaming table in Delta Live Tables (DLT)

Use the rate limiters along with the keyword LIVE....

Vector search index does not sync or update, and gives error EXECUTION_SERVICE_STARTUP_FAILURE.STORAGE_PERMISSION_ISSUE

Update the Azure Storage firewall settings to allow Databricks serverless compute subnets. ...

DLT pipeline fails with error DLT ERROR CODE: EXECUTION_SERVICE_STARTUP_FAILURE

Use the dbutils.fs.refreshMounts() command in the DLT code. ...

Permissions issue when trying to access DLT-managed streaming tables and materialized views in Unity Catalog

Grant required Unity Catalog permissions and apply a compatible compute type. ...

applyInPandasWithState fails with a ModuleNotFoundError when used with Delta Live Tables

Define a function within the notebook instead of calling it directly....

The Written metric in Delta Live Tables does not match the number of rows in the target table

The Written metric includes all attempted writes in the DLT pipeline....

Command %run not working on Delta Live Table (DLT) pipelines

Use DLT's built-in features for code reuse and dependency management instead. ...

ANALYZE statement not working on Delta Live Tables (DLT)

Allow the built-in maintenance job to run instead of using ANALYZE....

Delta Live Tables (DLT) cluster keeps running after pipeline completes

Switch your DLT pipeline to production mode....

Multiple tables created in a DLT pipeline using for loop have the same data/ schema of the last source table

Modify your code to pass the source table as an argument to the create_table function in the for loop....

Cannot see how to change the owner of a DLT pipeline in the Databricks UI

Ask a user with both metastore and workspace admin privileges to change the owner in the UI....

Non-admin users with 'CAN MANAGE' permissions on a specific DLT cluster can see the Spark UI but cannot view the driver logs

Set spark.databricks.acl.needAdminPermissionToViewLogs to false....

DLT pipeline failing with ConcurrentDeleteDeleteException error

Set the table property delta.enableRowTracking to true to enable row tracking on the table....

The SQL statement to create a table in Delta Live Tables (DLT) is ignored without errors

Create a new DLT pipeline with a new, separate SQL notebook for SQL statements....

Delta Live Tables (DLT) pipeline fails with SparkOutOfMemoryError

Upgrade your worker instance type or switch the channel from Preview to Current....