-
Notifications
You must be signed in to change notification settings - Fork 538
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Integration] OpenAI Batch API Agent #5274
Closed
samhita-alla opened this issue
Apr 23, 2024
· 0 comments
· Fixed by flyteorg/flytesnacks#1667 or #5291
Closed
[Integration] OpenAI Batch API Agent #5274
samhita-alla opened this issue
Apr 23, 2024
· 0 comments
· Fixed by flyteorg/flytesnacks#1667 or #5291
Comments
5 tasks
This was referenced Apr 25, 2024
This was referenced May 22, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The Flyte OpenAI batch API agent can be used to create a batch and poll the status of the OpenAI batch in real-time while remaining dormant. This means there's no need to incur costs when there's no work to be done. OpenAI's 50% model discount, as explained here, further enhances cost savings.
The agent seamlessly integrates with end-to-end Flyte workflows, making it especially useful when downstream tasks depend on batch processing jobs.
The text was updated successfully, but these errors were encountered: