Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeError: not a string #440

Open
neobie opened this issue Nov 6, 2023 · 0 comments
Open

TypeError: not a string #440

neobie opened this issue Nov 6, 2023 · 0 comments

Comments

@neobie
Copy link

neobie commented Nov 6, 2023

tokenizer = AutoTokenizer.from_pretrained("IDEA-CCNL/Randeng-Pegasus-238M-Summary-Chinese")

File "/opt/homebrew/lib/python3.8/site-packages/transformers/models/auto/tokenization_auto.py", line 786, in from_pretrained
return tokenizer_class_fast.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File "/opt/homebrew/lib/python3.8/site-packages/transformers/tokenization_utils_base.py", line 2024, in from_pretrained
return cls._from_pretrained(
File "/opt/homebrew/lib/python3.8/site-packages/transformers/tokenization_utils_base.py", line 2056, in _from_pretrained
slow_tokenizer = (cls.slow_tokenizer_class)._from_pretrained(
File "/opt/homebrew/lib/python3.8/site-packages/transformers/tokenization_utils_base.py", line 2256, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/opt/homebrew/lib/python3.8/site-packages/transformers/models/pegasus/tokenization_pegasus.py", line 149, in init
self.sp_model.Load(vocab_file)
File "/opt/homebrew/lib/python3.8/site-packages/sentencepiece/init.py", line 905, in Load
return self.LoadFromFile(model_file)
File "/opt/homebrew/lib/python3.8/site-packages/sentencepiece/init.py", line 310, in LoadFromFile
return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
TypeError: not a string

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant