You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Feature request for Sky Serve support of vLLMs --api-key flag. Presently Sky Serve has a mandatory health check in its YAML spec that cannot make unauthenticated post requests to the running vLLM server if an API key is passed.
Feature request for Sky Serve support of vLLMs
--api-key
flag. Presently Sky Serve has a mandatory health check in its YAML spec that cannot make unauthenticated post requests to the running vLLM server if an API key is passed.See the vLLM docs here
The text was updated successfully, but these errors were encountered: