-
Notifications
You must be signed in to change notification settings - Fork 91
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Getting UnicodeDecodeError accessing trie read from file #18
Comments
ok, never mind. I was taking the examples a little to litterally so i was loading a BytesTrie() into a constructed Trie() - once I switched to a constructed BytesTrie() it worked fine |
I'm glad it is not a bug in the marisa-trie source code :) |
So am I :) so as for the documentation, at the end of the load/save section, I'd just call out, that the Trie() constructor will not load a RecordTrie or a BytesTrie even though it will not fail. You need to construct the Trie class that you are trying to load. Alternatively, the load() methods could throw an exception if a trie file of the wrong type is presented. |
Part of the problem here is that the BytesTrie class should offer a static method for loading. The thought process that I think both jottos and I encountered was:
If you could call |
Hi, I'm consistently getting the following error when trying to access a trie from a load or read from a file.
I get the same error if the following code is used...
and again the same error if I use:
The trie file reads in w/o any error and i've written the file using both trie.save() and trie.write()
and in writing file I've used a codec.open() and codec.write() to force utf-8 encoding
I'm not sure if this is similar issue #10
The text was updated successfully, but these errors were encountered: