Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] other AI provider doesn't work with NonAzureOpenAI #40195

Closed
junan-trustarc opened this issue May 16, 2024 · 1 comment
Closed

[BUG] other AI provider doesn't work with NonAzureOpenAI #40195

junan-trustarc opened this issue May 16, 2024 · 1 comment
Assignees
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@junan-trustarc
Copy link

junan-trustarc commented May 16, 2024

Describe the bug
I am trying to use multiple AI providers using this SDK since payload is same,

  1. Azure OpenAI
  2. Open AI
  3. Perplexity AI

However, there is hard coded value OPEN_AI_ENDPOINT for nonAzureOpenAi and can't modify, so that only Azure OpenAI and OpenAi are working and doesn't work with other AI provider such as Perplexity AI even though payload of request, response is same.

To Reproduce
Steps to reproduce the behavior:
set endpoint = "https://api.perplexity.ai/"

Code Snippet
image
image
image

Expected behavior
Need to able to modify OPEN_AI_ENDPOINT (maybe rename to generic like nonAzureAiEndpoint) while creating OpenAIAsyncClient using OpenAIClientBuilder so that this will support for all other AI providers.

Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

  • [v] Bug Description Added
  • [v] Repro Steps Added
  • [v] Setup information Added
@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels May 16, 2024
@mssfang mssfang self-assigned this May 16, 2024
@mssfang
Copy link
Member

mssfang commented May 16, 2024

Hi @junan-trustarc

Unfortunately, we will not support non-OpenAI models in this SDK, azure-ai-openai as per our partnership with OpenAI.
The most major models are available as first-class Azure Host Endpoints, such as Llama2, Cohere and Mistra, via Azure MaaS (Azure AI Studio Model Catalog). They can also host most Hugging Face models or your own models in the future via Azure MaaP(AML) in the future. We will provide an ("OpenAI like") Model Inference API spec for completions to MaaS in the near future.

Worth to mention here that this SDK supports proxy feature in case someone not aware of it.

@mssfang mssfang closed this as completed Jun 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Development

No branches or pull requests

2 participants