New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
gate_cnn 模型GPU多卡训练报错 #337
Comments
一直不断的重复下面的信息: Waiting in store based barrier to initialize process group for rank: 5, key: store_based_barrier_key:1 (world_size=4, worker_count=19, timeout=0:30:00) GPU卡是:GeForce RTX 3090,BERT可以,gate_cnn为啥不行呢 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
python环境:
GPU cuda配置
多卡跑bert模型预训练是可以的
The text was updated successfully, but these errors were encountered: