-
Notifications
You must be signed in to change notification settings - Fork 176
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
deepspeed如何设置可以避免OOM #209
Comments
+1 |
1 similar comment
+1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
请问,deepspeed可以如何设置参数支持模型全量微调,机器只有4张32g的V100,deepspeed里面提到32g最多可以支持13B模型的训练?默认deepspeed的配置使用的是stage2吗?
The text was updated successfully, but these errors were encountered: