New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
State mapping cache ignores the tokenizer used to build the state machine #872
Labels
Comments
This might be the actual issue I was seeing in #853. |
@brandonwillard yes, I believe this might fix #853 too. |
What are the chances that I found this issue today and there is a bug reported today itself in github! I have a fix locally which I raised in #876 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the issue as clearly as possible:
outlines/outlines/fsm/guide.py
Line 115 in 4f8433d
The cached function actually depends on the regex and the tokenizer. The tokenizer is not a parameter of the function, though, which leads to cached state maps being shared across different tokenizers, which leads to errors.
Steps/code to reproduce the bug:
Expected result:
Error message:
No response
Outlines/Python version information:
Version information
Context for the issue:
No response
The text was updated successfully, but these errors were encountered: