Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: default_model 别名和 key 轮询 #4613

Open
QAbot-zh opened this issue May 4, 2024 · 9 comments
Open

[Feature Request]: default_model 别名和 key 轮询 #4613

QAbot-zh opened this issue May 4, 2024 · 9 comments
Labels
enhancement New feature or request

Comments

@QAbot-zh
Copy link

QAbot-zh commented May 4, 2024

Problem Description

  1. custom_model 支持对模型设置别名,但是 default_model 不支持,并且会把 custom_model 已经设置的模型别名挤掉,希望能把模型别名的 feature 移植到 default_model 上
  2. openai 类型支持多key轮询,gemini 和 claude 尚不支持,希望能把多 key 轮询的 feature 移植到其他的类型上

Solution Description

feature 移植

Alternatives Considered

No response

Additional Context

No response

@QAbot-zh QAbot-zh added the enhancement New feature or request label May 4, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Feature Request]: default_model alias and key polling

Problem Description

  1. custom_model supports setting aliases for the model, but default_model does not support it, and will crowd out the model aliases that have been set by custom_model. I hope that the feature of the model alias can be transplanted to default_model.
  2. The openai type supports multi-key polling, while gemini and claude do not yet support it. We hope to transplant the multi-key polling feature to other types.

Solution Description

feature transplant

Alternatives Considered

No response

Additional Context

No response

@Dean-YZG
Copy link
Contributor

Dean-YZG commented May 6, 2024

我理解,问题1:集中的焦点应该是默认模型将自定义过别名的模型的别名覆盖掉了,问题2:目前是随机轮序的方式,意味着,用户如果不输入特定apiKey,会随机使用任意一个环境设置的openApiKey,这种方式坦白说,不是一个很好的方式,请问希望gemini 和 claude也支持这种方式,有什么具体的应用场景呢?

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


I understand that question 1: The focus should be that the default model overwrites the aliases of models with customized aliases. Question 2: The current random order method means that if the user does not enter a specific apiKey, it will be used randomly. OpenApiKey set in any environment. Frankly speaking, this method is not a very good method. I hope gemini and claude will also support this method. What are the specific application scenarios?

@QAbot-zh
Copy link
Author

QAbot-zh commented May 6, 2024

我理解,问题1:集中的焦点应该是默认模型将自定义过别名的模型的别名覆盖掉了,问题2:目前是随机轮序的方式,意味着,用户如果不输入特定apiKey,会随机使用任意一个环境设置的openApiKey,这种方式坦白说,不是一个很好的方式,请问希望gemini 和 claude也支持这种方式,有什么具体的应用场景呢?

问题1 对的,就是指把别名挤掉了,因为有时候别名想加一些特殊的说明标记。
问题2 多key轮询,最早OpenAI类型增加这个feature,其实是为了绕开单个key的rate limit,比如同一个网页端有多人同时使用的时候。

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


I understand that question 1: The focus should be that the default model overwrites the aliases of models with customized aliases. Question 2: The current random order method means that if the user does not enter a specific apiKey, it will be randomly Use openApiKey set in any environment. Frankly speaking, this method is not a very good method. I hope gemini and claude also support this method. What are the specific application scenarios?

Question 1 Yes, it means squeezing out the aliases, because sometimes you want to add some special explanation marks to the aliases.
Question 2 Multi-key polling. The earliest OpenAI type added this feature was actually to bypass the rate limit of a single key, such as when multiple people are using the same web page at the same time.

@Dean-YZG
Copy link
Contributor

Dean-YZG commented May 6, 2024

问题1 已修复 #4625
问题2 #4626

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Issue 1 Fixed #4625
Question 2 #4626

@SuiYunsy
Copy link

SuiYunsy commented May 17, 2024

问题1 已修复 #4625 问题2 #4626

最新版设置DEFAULT_MODEL后,无痕首次打开网页,对话界面查看模型还是gpt-3.5-turbo。
只有点击左下角设置后,默认模型才会更改,此时回到对话界面查看模型才是设置的默认模型。
或者就是首次直接打开/#/setting,然后再回到对话界面才是设置的默认模型。


有点玄学的是,我无痕测试了好几次,有时候是默认模型,有时候是3.5。。。莫非和加载速度还有关系吗😂

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Issue 1 Fixed #4625 Issue 2 #4626

After setting DEFAULT_MODEL in the latest version, when Wuhen opens the webpage for the first time, the dialog interface shows that the model is still gpt-3.5-turbo.
The default model will be changed only after clicking Settings in the lower left corner. At this time, returning to the dialog interface to view the model will be the set default model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants
@QAbot-zh @Issues-translate-bot @SuiYunsy @Dean-YZG and others