Lost workers due to autoscaling events

Benign message for termination events.

Written by jairo.prado

Last published at: July 18th, 2025

Problem

You are reviewing your cluster driver logs and you see TaskSchedulerImpl: Lost executor errors, even though there are no signals of high resource utilization, networking issues, or any other issue.

TaskSchedulerImpl: Lost executor 101 on 10.162.54.201: worker lost: 10.162.54.201:39561 got disassociated

 

Cause

This message may show up in the cluster driver logs when a worker gets terminated due to a downscaling event, manual termination, or spot instance termination.

 

Solution

The error message can be safely ignored if the worker is lost due to a downscaling event, manual termination, or spot instance termination.