Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gemini: auto-retry, auto-continue #473

Open
enricoros opened this issue Mar 30, 2024 · 0 comments
Open

Gemini: auto-retry, auto-continue #473

enricoros opened this issue Mar 30, 2024 · 0 comments

Comments

@enricoros
Copy link
Owner

Implement a "fixer" for Gemini, as the chance of calls breaking is very high, and token limits are often reached even earlier than expected. For this, implement:

  • (easy) an auto-retry with exponential backoff up to 3 times for generation calls, which will retry on error and on the server side
  • (hard) an auto-continue which can virtually extend the token size of the network, and will require a UI checkbox option for the user, so we can kick it in
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant