New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
旧版本和新版本都无法部署web界面的交互 #3680
Comments
可以先自主尝试一下不使用本项目,是否可以部署 gradio 自身的简单demo, 排查一下网络问题。 |
通过 localhost:7860 打开 |
05/16/2024 08:27:51 - INFO - llmtuner.model.utils.attention - Using torch SDPA for faster training and inference. To create a public link, set |
Reminder
Reproduction
我在新旧版本上运行代码提示如下错误:可是我的网络也没有什么异常,请问该怎么解决?谢谢
Could not create share link. Please check your internet connection or our status page: https://status.gradio.app.
新版本llama_fatory_main中,运行脚本如下:
CUDA_VISIBLE_DEVICES=1 python src/webui.py
--model_name_or_path /Llama-2-7b-hf
--adapter_name_or_path mycheckpoint_path
--template default
--quantization_bit 4
--finetuning_type lora
import os
from llmtuner.webui.interface import create_ui
webui.py为:
def main():
server_name = os.environ.get("GRADIO_SERVER_NAME", "0.0.0.0")
server_port = int(os.environ.get("GRADIO_SERVER_PORT", "8023"))
gradio_share = bool(int(os.environ.get("GRADIO_SHARE", "1")))
create_ui().queue().launch(share=gradio_share, server_name=server_name, server_port=server_port)
if name == "main":
main()
Expected behavior
可以实现在web界面交互
System Info
No response
Others
No response
The text was updated successfully, but these errors were encountered: