Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

旧版本和新版本都无法部署web界面的交互 #3680

Closed
1 task done
caoyaru123 opened this issue May 10, 2024 · 3 comments
Closed
1 task done

旧版本和新版本都无法部署web界面的交互 #3680

caoyaru123 opened this issue May 10, 2024 · 3 comments
Labels
solved This problem has been already solved.

Comments

@caoyaru123
Copy link

Reminder

  • I have read the README and searched the existing issues.

Reproduction

我在新旧版本上运行代码提示如下错误:可是我的网络也没有什么异常,请问该怎么解决?谢谢
Could not create share link. Please check your internet connection or our status page: https://status.gradio.app.

新版本llama_fatory_main中,运行脚本如下:
CUDA_VISIBLE_DEVICES=1 python src/webui.py
--model_name_or_path /Llama-2-7b-hf
--adapter_name_or_path mycheckpoint_path
--template default
--quantization_bit 4
--finetuning_type lora
import os

from llmtuner.webui.interface import create_ui

webui.py为:
def main():
server_name = os.environ.get("GRADIO_SERVER_NAME", "0.0.0.0")
server_port = int(os.environ.get("GRADIO_SERVER_PORT", "8023"))
gradio_share = bool(int(os.environ.get("GRADIO_SHARE", "1")))
create_ui().queue().launch(share=gradio_share, server_name=server_name, server_port=server_port)

if name == "main":
main()

Expected behavior

可以实现在web界面交互

System Info

No response

Others

No response

@codemayq
Copy link
Collaborator

可以先自主尝试一下不使用本项目,是否可以部署 gradio 自身的简单demo, 排查一下网络问题。

@codemayq codemayq added the pending This problem is yet to be addressed. label May 11, 2024
@hiyouga hiyouga added solved This problem has been already solved. and removed pending This problem is yet to be addressed. labels May 11, 2024
@hiyouga
Copy link
Owner

hiyouga commented May 11, 2024

通过 localhost:7860 打开

@hiyouga hiyouga closed this as completed May 11, 2024
@chuangzhidan
Copy link

chuangzhidan commented May 16, 2024

可以先自主尝试一下不使用本项目,是否可以部署 gradio 自身的简单demo, 排查一下网络问题。

05/16/2024 08:27:51 - INFO - llmtuner.model.utils.attention - Using torch SDPA for faster training and inference.
05/16/2024 08:27:51 - INFO - llmtuner.model.adapter - Fine-tuning method: LoRA
05/16/2024 08:27:52 - INFO - llmtuner.model.adapter - Loaded adapter(s): /workspace/LLaMA-Factory/saves/qwen-7b/lora/sft/
05/16/2024 08:27:52 - INFO - llmtuner.model.loader - all params: 760614912
Running on local URL: http://0.0.0.0:7860

To create a public link, set share=True in launch().
服务器运行,打开服务器ip+7860却提示:您访问的网页出错了!
网络连接异常、网站服务器失去响应
lsof 命令:lsof -i :7860 为空
请问下大佬这是什么原因哈,谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved.
Projects
None yet
Development

No branches or pull requests

4 participants