You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My issue is NOT present when using pandas without alone (without pandarallel)
Bug description
Using requests inside the mapped function causes troubles.
The process has forked and you cannot use this CoreFoundation functionality safely. You MUST exec().
Break on __THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__() to debug.
Observed behavior
Function get stuck.
Expected behavior
Function runs fine.
Minimal but working code sample to ease bug fix for pandarallel team
create a separate file to hold the test functions called test_fns.py
Another strange aspect is that if you call the function without creating a new process test_fns.request('') before applying parallel_map or simply make a request before applying parallel_map (for instance requests.get('http://github.com') everything runs fine.
The text was updated successfully, but these errors were encountered:
General
Acknowledgement
pandas
without alone (withoutpandarallel
)Bug description
Using
requests
inside the mapped function causes troubles.Observed behavior
Function get stuck.
Expected behavior
Function runs fine.
Minimal but working code sample to ease bug fix for
pandarallel
teamcreate a separate file to hold the test functions called
test_fns.py
Create another file that contains the actual script
Other considerations:
Starting the processes in spawn mode solves the problem.
Forcing spawn mode with
solves the problem.
Another strange aspect is that if you call the function without creating a new process
test_fns.request('')
before applying parallel_map or simply make a request before applying parallel_map (for instancerequests.get('http://github.com')
everything runs fine.The text was updated successfully, but these errors were encountered: