Discussions

• 2 You must be logged in to vote

  💬

  litellm.exceptions.APIConnectionError: {"detail":"Not Found"} when trying to call completion

  techybolek started Dec 3, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  What parameters required for using quantized llama2 models?

  suhjohn asked Sep 22, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  ROCm support

  ehartford asked Sep 16, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  [Query] 请问lightllm支持llama2模型的多batch推理吗？

  ChristineSeven asked Sep 6, 2023 in Q&A · Unanswered

  

  

  0