Problem

When migrating a Delta table between workspaces, multiple users in an organization copy the data to migrate. You subsequently notice file losses and failures that corrupt the Delta table.

Cause

Connectivity or network issues can interrupt manual copying of Terabytes of data. These issues lead to data losses and failures. 

Solution

First, set up Delta Sharing for the Delta table from which you are migrating the data. Follow the instructions in the What is Delta Sharing? (AWS | Azure) documentation.

After setting up Delta Sharing, clone the shared Delta table. Follow the instructions in the Clone a table on Databricks (AWS | Azure) documentation.