Weird/unexpected error with APIM load balancer

[diberry]

I used this repo to test the ACA LB, which worked. I could see the streaming logs in ACA of LB to see that it worked.

Then I needed to test APIM. I deployed APIM and got the BE URL and set it in this repo and azd up'd again.

It took a really long time to deploy but I didn't see any errors. When I tried the website, it gave me the following screenshot.

I don't know why it thinks I'm going against OpenAI when my env file says Azure OpenAI.

AZURE_AUTH_TENANT_ID=""
AZURE_DOCUMENTINTELLIGENCE_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_DOCUMENTINTELLIGENCE_SERVICE="cog-di-k6bwjkzvzcdoe"
AZURE_ENV_NAME="diberry-py-chat-0511-01"
AZURE_KEY_VAULT_NAME=""
AZURE_LOCATION="eastus2"
AZURE_OPENAI_API_VERSION=""
AZURE_OPENAI_CHATGPT_DEPLOYMENT="chat"
AZURE_OPENAI_CHATGPT_MODEL="gpt-35-turbo"
AZURE_OPENAI_CUSTOM_URL="https://apim-pryjlfx4rfqs6.azure-api.net"
AZURE_OPENAI_EMB_DEPLOYMENT="embedding"
AZURE_OPENAI_EMB_MODEL_NAME="text-embedding-ada-002"
AZURE_OPENAI_GPT4V_DEPLOYMENT="gpt-4v"
AZURE_OPENAI_GPT4V_MODEL="gpt-4"
AZURE_OPENAI_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_OPENAI_SERVICE="cog-k6bwjkzvzcdoe"
AZURE_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_SEARCH_INDEX="gptkbindex"
AZURE_SEARCH_SECRET_NAME=""
AZURE_SEARCH_SEMANTIC_RANKER="free"
AZURE_SEARCH_SERVICE="gptkb-k6bwjkzvzcdoe"
AZURE_SEARCH_SERVICE_ASSIGNED_USERID="c66c97a6-9037-445e-91f2-4f608a4aca7d"
AZURE_SEARCH_SERVICE_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_STORAGE_ACCOUNT="stk6bwjkzvzcdoe"
AZURE_STORAGE_CONTAINER="content"
AZURE_STORAGE_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_SUBSCRIPTION_ID="2123cb08-23fa-4a80-afec-4ec9e015433f"
AZURE_TENANT_ID=""
AZURE_USERSTORAGE_ACCOUNT=""
AZURE_USERSTORAGE_CONTAINER="user-content"
AZURE_USERSTORAGE_RESOURCE_GROUP="rg-diberry-py-chat-0511-01"
AZURE_USE_AUTHENTICATION="false"
AZURE_VISION_ENDPOINT=""
BACKEND_URI="https://app-backend-k6bwjkzvzcdoe.azurewebsites.net"
OPENAI_API_KEY=""
OPENAI_HOST="azure_custom"
OPENAI_ORGANIZATION=""

[pamelafox]

That error could also come from Azure OpenAI, it's the same class for both clients, I believe. Did you find the actual error in the logs / App Insights?