Skip to content

Commit

Permalink
Revert "UI v1"
Browse files Browse the repository at this point in the history
  • Loading branch information
PromtEngineer committed Jun 15, 2023
1 parent 57d4f5e commit ec16c02
Show file tree
Hide file tree
Showing 54 changed files with 0 additions and 61,057 deletions.
35 changes: 0 additions & 35 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,41 +100,6 @@ In order to ask a question, run a command like:
python run_localGPT.py --device_type cpu
```

# Run the UI
1. Start by opening up `run_localGPTAPI.py` in a code editor of your choice. If you are using gpu skip to step 3.

2. If you are running on cpu change `DEVICE_TYPE = 'cuda'` to `DEVICE_TYPE = 'cpu'`.

* Comment out the following:
```shell
model_id = "TheBloke/WizardLM-7B-uncensored-GPTQ"
model_basename = "WizardLM-7B-uncensored-GPTQ-4bit-128g.compat.no-act-order.safetensors"
LLM = load_model(device_type=DEVICE_TYPE, model_id=model_id, model_basename = model_basename)
```
* Uncomment:
```shell
model_id = "TheBloke/guanaco-7B-HF" # or some other -HF or .bin model
LLM = load_model(device_type=DEVICE_TYPE, model_id=model_id)
```

* If you are running gpu there should be nothing to change. Save and close `run_localGPTAPI.py`.

3. Open up a terminal and activate your python environment that contains the dependencies installed from requirements.txt.

4. Navigate to the `/LOCALGPT` directory.

5. Run the following command `python run_localGPT_API.py`. The API should being to run.

6. Wait until everything has loaded in. You should see something like `INFO:werkzeug:Press CTRL+C to quit`.

7. Open up a second terminal and activate the same python environment.

8. Navigate to the `/LOCALGPT/localGPTUI` directory.

9. Run the command `python localGPTUI.py`.

10. Open up a web browser and go the address `http://localhost:5111/`.

# How does it work?

Selecting the right local models and the power of `LangChain` you can run the entire pipeline locally, without any data leaving your environment, and with reasonable performance.
Expand Down
51 changes: 0 additions & 51 deletions localGPTUI/localGPTUI.py

This file was deleted.

0 comments on commit ec16c02

Please sign in to comment.