[BUG] 简洁阐述问题 / Concise description of the issue

[starry-sky-domain]

问题描述 / Problem Description
开发者有没有验证过基于在线模型 Gemini 、Claude 的在线API调用？根本就跑不通。是拿来凑数的吗？
使用 Gemini 在线模型，调用 Gemini 接口的时候，直接就阻塞了。毫无反应。

[dosubot]

It appears there might be several factors contributing to the issue you're experiencing with the Gemini and Claude online model APIs. For the Gemini API, the problem could stem from dependencies like fastchat for conversation handling, httpx for HTTP requests, or issues with the external service itself at https://generativelanguage.googleapis.com/v1beta/models/gemini-pro:generateContent. Any downtime, rate limiting, or API changes with this external service could lead to the blocking behavior you've observed.

For the Claude online model, recent updates indicated by headers such as 'anthropic-beta' with the value 'messages-2023-12-15' suggest there have been changes that could potentially affect API behavior. Both models require specific configurations, including API keys and model names, which if not correctly set, could also cause issues.

The provided code does include logging, especially if log_verbose is set to True, which could offer more insights into the request being made and help in debugging the issue. Checking the logs for any error messages or unusual behavior during the API call could be a good starting point.

If you're still facing issues, ensuring that all configurations are correctly set according to the latest documentation and checking for any updates or known issues with the external services or dependencies could help resolve the problem.

Details

Sources

• server/model_workers/gemini.py
• server/model_workers/claude.py
• configs/server_config.py.example
• configs/model_config.py.example

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[JesseXYF]

你是不是搭建的有什么问题，我搭建的在线模型 Gemini 还在正常使用

[starry-sky-domain]

的确还是不行。我重新拉取了代码，重新安装文档进行配置。依旧不行。经过我的排查，是在GeminiWorker那里，如果直接使用一个demo案例直接请求Gemini的话，是可以的。通过项目去请求就不行。麻烦大佬们看看，谢谢。 莫失莫忘  

…

------------------ 原始邮件 ------------------ 发件人: "chatchat-space/Langchain-Chatchat" ***@***.***>; 发送时间: 2024年4月28日(星期天) 中午11:50 ***@***.***>; ***@***.******@***.***>; 主题: Re: [chatchat-space/Langchain-Chatchat] [BUG] 简洁阐述问题 / Concise description of the issue (Issue #3907) 你是不是搭建的有什么问题，我搭建的在线模型 Gemini 还在正常使用 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[JesseXYF]

邮件已收到，谢谢。