Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not fine tuning lanague model using Colab #289

Open
Kowsher opened this issue May 6, 2021 · 1 comment
Open

Can not fine tuning lanague model using Colab #289

Kowsher opened this issue May 6, 2021 · 1 comment

Comments

@Kowsher
Copy link

Kowsher commented May 6, 2021

When I'm going to train to fine-tune LM in colab it says
Please install apex to use fp16 training
cannot import name 'UnencryptedCookieSessionFactoryConfig' from 'pyramid.session' (unknown location) During handling of the above exception

@Elzic6
Copy link

Elzic6 commented May 10, 2021

Hi Kowsher,
I had the same issue, then after a while..., I found a solution that works for me :
Problem : when you install apex in colab, you get multiple versions of cuda installed, and you have to indicate the good version to use : I found the solution here (look at the comment : artitw commented on 5 Apr 2020) :
NVIDIA/apex#754

to sumup :
1- open your colab notebook,
2- connect your google drive (from google.colab import drive),
3- install apex with the following code
export CUDA_HOME=/usr/local/cuda-10.1
pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" pytorch-extension

hope this will works for you too :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants