[Q] Prioritizing Runs in Grid Search Sweeps

[itay-nakash]

Hi everyone,

I'm using a sweep with grid search across several parameters, and each run is pretty time-consuming.
I would like to prioritize runs with certain hyperparameters, that are more urgent for my testing, modeling, and reports.
However, I can't find a convenient way to prioritize the runs, other than manually managing the agents by starting and stopping them until they hit the desired parameters, then cleaning up by deleting the killed runs to ensure they eventually get executed.

Is there a more elegant solution for prioritizing runs in a grid search? Or am I missing something?

If not, I would suggest adding a "priority" feature to grid search sweeps.
For instance, allowing users to specify the order of experiments or choose specific ones to prioritize, or perhaps a flag that could be added to the wandb agent lunching command to define the desired parameters for the first run.

Thanks for your help!

[luisbergua]

Hi @itay-nakash, thanks for sharing this helpful feedback! That's currently not possible but I'll be happy to submit a feature request internally for you