Problem
You are unable to access your original Delta Live Table (DLT) tables.
When you navigate to the Catalog tab of the UI, you notice the message “Table <table-name> does not exist”
is displayed.
When you check the DLT UI (in Jobs & Pipelines) you see the table names are automatically changing from <table-name>
to a format prefixed with the schema ID, such as __<schema_id>_<table_name>
.
Cause
In your DLT pipeline configuration, you have the temporary
parameter set to True
.
When temporary
is set to True
, DLT treats the tables as temporary assets, which are not intended for access outside the pipeline.
Solution
In a notebook, you can set the temporary
variable option to False
while calling DLT decorator.
@<your-dlt-table-name>(
temporary=False
)
<rest-of-your-DLT-code-logic>
Alternatively, also in a notebook, you can remove the temporary variable option while calling DLT decorator.
@<your-dlt-table-name>
<rest-of-your-DLT-code-logic>