ModelTC lightllm General · Discussions · GitHub

[Query] 请问lightllm支持llama2模型的多batch推理吗？
Q&A ChristineSeven

General Discussions

Chat about anything and everything here

You must be logged in to vote

litellm.exceptions.APIConnectionError: {"detail":"Not Found"} when trying to call completion

techybolek started Dec 3, 2023 in General

0