Stop specific worker in Horovod Elastic

[mozizhao]

Hi there,

After reading the code and document, I found that there is no design for stopping a specific worker when applying the Horovod Elastic (e.g., when the number of available workers decreases from 4 to 3, I want to stop the worker of rank 1). Is it possible to do so? Code intrusion for user code is ok.