Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Add old ui as example #344

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

Bojun-Feng
Copy link
Contributor

Rewrote deprecated Gradio UI with RESTful Client and added it to examples as gradio_arena.py.

Instructions should be available by running the file with the --help tag.
e.g. python path/to/inference/examples/gradio_arena.py --help

Here are the instructions, in case anyone needs it:

instructions to run:

    1. Install Xinference, Llama-cpp-python, and other dependencies if necessary
    2. Run command `xinference --host "localhost"` in terminal
    3. You should see something similar to the following output:

    INFO:xinference:Xinference successfully started. Endpoint: http://localhost:9997
    INFO:xinference.core.service:Worker 127.0.0.1:21561 has been added successfully
    INFO:xinference.deploy.worker:Xinference worker successfully started.

    4. In the output, locate the endpoint. In the above case it is `http://localhost:9997`
    5. Run this python file in new terminal window, change the endpoint accordingly

    example run command (feel free to copy):

    python gradio_arena.py \
    --endpoint http://localhost:9997

@XprobeBot XprobeBot added the enhancement New feature or request label Aug 11, 2023
@XprobeBot XprobeBot added this to the v0.2.0 milestone Aug 11, 2023
@Bojun-Feng Bojun-Feng marked this pull request as ready for review August 11, 2023 09:50
examples/gradio_arena.py Show resolved Hide resolved
examples/gradio_arena.py Outdated Show resolved Hide resolved
@UranusSeven
Copy link
Contributor

Please also add this example to the docs: https://inference.readthedocs.io/en/latest/examples/index.html

You need to create a new rst file in this folder and add it to the index's tree of contents.

@XprobeBot XprobeBot modified the milestones: v0.2.0, v0.2.1 Aug 21, 2023
@XprobeBot XprobeBot modified the milestones: v0.2.1, v0.3.1 Sep 5, 2023
@XprobeBot XprobeBot modified the milestones: v0.4.0, v0.4.2, v0.4.3, v0.4.4 Sep 12, 2023
@XprobeBot XprobeBot modified the milestones: v0.4.4, v0.4.5, v0.5.0, v0.5.1 Sep 19, 2023
@XprobeBot XprobeBot modified the milestones: v0.5.1, v0.5.2 Sep 27, 2023
@XprobeBot XprobeBot modified the milestones: v0.8.2, v0.8.4, v0.8.5, v0.9.0 Feb 2, 2024
@XprobeBot XprobeBot modified the milestones: v0.9.0, v0.9.1 Feb 22, 2024
@XprobeBot XprobeBot modified the milestones: v0.9.1, v0.9.2, v0.9.3 Mar 1, 2024
@XprobeBot XprobeBot modified the milestones: v0.9.3, v0.9.4, v0.9.5 Mar 15, 2024
@XprobeBot XprobeBot modified the milestones: v0.10.0, v0.10.1 Mar 29, 2024
@XprobeBot XprobeBot modified the milestones: v0.10.1, v0.10.2 Apr 12, 2024
@XprobeBot XprobeBot modified the milestones: v0.10.2, v0.10.3, v0.11.0 Apr 19, 2024
@XprobeBot XprobeBot modified the milestones: v0.11.0, v0.11.1, v0.11.2 May 11, 2024
@XprobeBot XprobeBot modified the milestones: v0.11.2, v0.11.3 May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants