Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bge-reranker-v2-m3 环境配置咨询 #763

Open
ericalduo opened this issue May 10, 2024 · 1 comment
Open

bge-reranker-v2-m3 环境配置咨询 #763

ericalduo opened this issue May 10, 2024 · 1 comment

Comments

@ericalduo
Copy link

本机环境:python=3.8,pytorch=1.11.0,nvidia-smi=450.119.04,cuda version=11.0,nvcc -V=11.3.109
执行pip install FlagEmbedding成功
python控制台执行
from FlagEmbedding import FlagReranker
reranker = FlagReranker('/root/workspace/bge-reranker-v2-m3', use_fp16=True)
会大约1分钟没响应,然后显示“killed”并退出了python控制台
请问下是因为配置环境导致这样问题,或者是其他?或者在哪里可以看到具体报错日志?

@545999961
Copy link
Collaborator

可能是pytorch版本比较低的缘故
可以尝试reranker = FlagReranker('/root/workspace/bge-reranker-v2-m3', use_fp16=False, device='cpu')将模型放在CPU上看是否可以顺利加载

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants