fastchat 服务如何使用，我想在其他平台使用，我私有的模型，应该如何填写

[yumu7777777]

API endpoint URL如何写，貌似不是 http://ip:20000 de 服务

[dosubot]

To integrate your private model with the "fastchat" service and correctly set up the API endpoint URL, you should refer to the official API documentation of the "fastchat" service for the precise endpoint structure. The configuration for the API, including the base URL (api_base_url), API key (api_key), and other necessary parameters, should be specified according to the service's requirements. Typically, the api_base_url will be the base URL of your service, and the API key should be included in the request headers or as a query parameter, as dictated by the "fastchat" service's API guidelines.

Ensure you specify the request type and completion mode correctly in your request, based on the available options in the "fastchat" service's API. If "http://ip:20000" does not seem to work, it's likely that the service expects a different format or additional parameters.

For detailed instructions on setting these parameters and for examples of the correct URL format, please consult the "fastchat" service's documentation or the API guide provided with your service. This will give you the most accurate and specific guidance on how to proceed.

Details

Sources

• server/model_workers/base.py
• server/api.py
• server/chat/completion.py
• server/model_workers/zhipu.py
• webui.py
• tests/test_online_api.py

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[yumu7777777]

Langchain-Chatchat 不是集成了fastchat吗？我看server_config.py 中提到的端口就是 20000啊，或者我应该在哪去找相关文档呢

[ghyaauoo]

如果model_worker配置端口没改的话，默认20002