New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RuntimeWarning in Fine-tune Llama 3 with ORPO.ipynb #65
Comments
No idea but you can use multiprocessing instead of os to get rid of this
warning.
…On Mon, Apr 22, 2024 at 12:35 AM lxt3 ***@***.***> wrote:
Could you please explain the runtime warning in cell 3 in Fine-tune Llama
3 with ORPO.ipynb:
/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66:
RuntimeWarning: os.fork() was called. os.fork() is incompatible with
multithreaded code, and JAX is multithreaded, so this will likely lead to a
deadlock. self.pid = os.fork()
Is JAX being somewhere in the notebook? I'm afraid I cannot see why this
warning occurs.
—
Reply to this email directly, view it on GitHub
<#65>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ATL5EGUQN5MY6DC46JV3TCDY6RELHAVCNFSM6AAAAABGRYOOGKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2TKMZSHAYTANI>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Could you please explain the runtime warning in cell 3 in Fine-tune Llama 3 with ORPO.ipynb:
/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. self.pid = os.fork()
Is JAX being somewhere in the notebook? I'm afraid I cannot see why this warning occurs.
The text was updated successfully, but these errors were encountered: