-
Notifications
You must be signed in to change notification settings - Fork 109
MultiProcessing #43
Comments
I'm having the same issue. @Amiiirali did you already find a way to fix this? I'm using PyTorch for data loading and transformations. I've added the Macenko normalization to my transformation pipeline. When I set ====== EDIT ======= I've dug deeper, and I've noticed it's breaking inside
This probably gives an overhead when spawning this process with multiple processes already. When changing this to @Peter554 I see that you have a stale branch where you removed the SPAMS dependency and used the sklearn lasso function. Is this stable, or an unfinished functionality? In either way, is it worth to create a PR to add some arguments to some functions that in the end set numThreads=1 in the SPAMS lasso regression? |
@YoniSchirris Not really. I spent two days on it, but there is no any solution. The problem is the spams library. As long as you use SPAMS in the multiprocessing process, it instantly freezes. I do not know that much, but probably it depends on the C++ code of that library. About Please keep me updated if you find a solution. |
@Amiiirali So by itself it sets So go to e.g. It's probably safest to make a new file in your repo that overwrites this file. Let me know if you manage to solve it with this, it works for me. |
Hello,
I want to use multiple CPUs to accelerate the function.
When I use your class in multiprocessing, the kernel just freezes, and it does not do anything.
Can you help on this?
Thanks,
The text was updated successfully, but these errors were encountered: