Problem

Non-admin users are unable to view job logs for jobs triggered by Azure Data Factory (ADF) unless they have admin permissions, preventing them from troubleshooting or understanding a job’s execution. 

When a non-admin users tries to access the job run, they see the following message on their job run page.

Job run not available or not found
The URL may be misspelled or the run you're looking for is no longer available.
Databricks keeps job run results and compute logs for 60 days after termination. For runs that have not expired yet, you can export job run results. To save a copy of the compute logs for future runs, enable compute log delivery to have the logs delivered to cloud storage
Parent job of this run: No job found for this run | Jobs Page

Cause

By default, ADF-triggered job runs inherit permissions from the job’s notebook. This behavior is by design, to ensure only authorized users can view job logs and related information. 

Solution

You can allow non-admin users to access Azure Databricks job logs without granting full admin privileges, so they can debug or conduct analysis.

As an admin, follow these steps on behalf of the non-admin user: 

1. Navigate to your Azure Databricks workspace and locate the job's notebook.
2. Click on the Share button on the top right corner of the notebook.
3. In the Share Notebook dialog box, search for the user or group that needs access to the job logs.
4. Select the user or group and grant them the Can View permission.