-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Correction in API Base URL for chat/completion requests #539
Comments
This seems to be drives from your local IP of your home network? Yes that should have been localhost and not using ifconfig |
this seems connected to #474 |
I think that is kinda expected, so we need to think if we want to have a special rule for localhost eventually in the frontend or daemon. This is only for development after all |
I have a different result instead @Janaka-Steph using https://demo.prem.ninja The Service Details page shows correctly the baseUrl for LLama service But then the playground chat calls the wrong baseUrl ie. ![]() |
Can you check TanStack devtool ? |
I am on released on |
I am making a new Docker release using latest main, let's see if it fixes |
We can add devtool on production, hidden and lazy loaded, triggered by a command in browser console |
The front just use service.baseUrl here |
But baseUrl in the service detail page seems correct |
Surprise! |
The current base URL used for chat/completion requests is pointing to an incorrect host(62.4.58.131), causing a failure in request processing.
http://62.4.58.131/gpt4all-lora-q4/v1/chat/completions
@tiero @Janaka-Steph
The text was updated successfully, but these errors were encountered: