New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Q] Initialize multiple runs and update them simultaneously #7378
Comments
hey @ksmdnl - currently we don't support logging more than 1 run in the same process. this would have to be done sequentially. alternatively, perhaps you can utilize Python's multiprocessing library to spin up separate processes. Each process can handle its own W&B run, allowing you to independently log different forward passes or experiments. Please let me know if you have further questions or would like to discuss further! |
Hi @umakrishnaswamy, thanks for the input! To be clear, in my scenario it's only one experiment with multiple forward passes per step (which includes the optimization) and I would like to log the output of each pass. |
@ksmdnl - got it, unfortunately we do not support this right now since we can only update one run at a time, and you would have to terminate the other run in order to log to the new run. I'd be happy to make a feature request for this, and I'll update this thread if any progress arises on it. |
@umakrishnaswamy yes, that would be very helpful. Thanks! |
Thank you for the never ending support of the API!
I have a scenario where I have multiple forward passes in each step. I imagine initialising multiple wandb runs and update them independently. Is there a feature that might support this use case?
This is roughly what I would like to have:
The closest I found is #1063, but this is not exactly the same scenario, since it runs each run one after the other.
I’ll appreciate any kind of hints!
The text was updated successfully, but these errors were encountered: