-
-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: If I use assistants, it will allow me to go over token budget #2105
Labels
bug
Something isn't working
Comments
Thanks I’ve triaged the issue and will push a fix soon. |
I'm not using OpenRouter, though. It isn't one of my endpoints. My OPENROUTER_API_KEY does have a key set to it, but I'm not using that endpoint when I get that error message. That's the odd thing. |
Do not use this variable, see #2097 |
11 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What happened?
When I use OpenAI directly as an endpoint, it will block my requests as i come to the limit of tokens. However, when i use Assistants, it ignores the fact that I went over limit, and continues to process all requests.
is it expected behavior?
Steps to Reproduce
login to account with minimal or negative credit
try to run request on openai assistant - it should block if runs over allowed limits
then select any assistant with openai backend, and run same request
-> it will continue to process requests as normal, without taking into consideration that the allotted token limits is overused.
What browsers are you seeing the problem on?
Chrome
Relevant log output
No response
Screenshots
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: