These articles can help you with the Databricks File System (DBFS).
- Cannot access objects written by Databricks from outside Databricks
- Cannot read Databricks objects stored in the DBFS root directory
- How to calculate the Databricks file system (DBFS) S3 API call cost
- How to specify the DBFS path
- Operation not supported during append
- Parallelize filesystem operations
- S3 connection reset error