[Bug]: Using OPENROUTER_API_KEY breaks all librechat.yaml custom endpoints

[fuegovic]

What happened?

I attempted to configure OpenRouter using OPENROUTER_API_KEY to override the OpenAI endpoint, to use gpt-3.5/gpt-4 and plugins with them instead of OpenAI. However, this modification disrupted all other custom endpoints I had configured in the YAML configuration file, with the exception of OpenRouter itself.

Steps to Reproduce

1. Set OPENROUTER_API_KEY
2. Try to use another custom endpoint, e.g. groq

Relevant log output

I can produce more logs if required:

warn: [OpenAIClient.chatCompletion][stream] API error
warn: [OpenAIClient.chatCompletion][finalChatCompletion] API error
error: [OpenAIClient.chatCompletion] Unhandled error type Error: 404 Model llama2-70b-4096 is not available
[handleAbortError] AI response error; aborting request: Error: 404 Model llama2-70b-4096 is not available

Screenshots

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

This is why OPENROUTER_API_KEY is not recommended for use. however I can think of a way to hotfix preventing the "breaking"

[fuegovic]

This is why OPENROUTER_API_KEY is not recommended for use. however I can think of a way to hotfix preventing the "breaking"

That would be great! OpenAI recently switched to pre-paid billing, and they’ve decided to stop accepting my money at the same time for some mysterious reasons 🤷‍♂️. I’m already paying for the same models in two places so I figured I’d switch over to OpenRouter. Since I don’t really use assistants and I can easily integrate OpenRouter with plugins I wouldn't loose much.