-
Notifications
You must be signed in to change notification settings - Fork 527
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Doesn't seem to obey --path argument, instead try to download to .cache again #20
Comments
Before the argument The weight download function is here. |
You can modify where the |
@Ying1123 Hi, I have the same confusion when I downloaded the model of facebook/opt-30b from huggingface, and the model files can't be recognized by transformers==4.25.1, so is there a way to use local weights? |
On Windows at least, it seems to be path is not obeyed and kept downloading into .cache directory of the c:\ file system (which I don't have enough space.)
I've manually downloaded required files into other drive, where the relative path is ../models--facebook--opt-30b
Executing
python -m flexgen.flex_opt --model facebook/opt-30b --path ../models--facebook--opt-30b
still causes it to download the item into aforementioned .cache directory -- tried other variantpython -m flexgen.flex_opt --model facebook/opt-30b --path ../models--facebook--opt-30b/snapshots/ceea0a90ac0f6fae7c2c34bcb40477438c152546
.Am I misunderstanding the way --path work or there's something wrong with it?
Also it would be nice to have the option to inhibit all the automatic download and just stop with error as I do not want to exhaust disk space that's already precious...
The text was updated successfully, but these errors were encountered: