Question: How to add payload when using text-gen-web-ui?

[HamsterDumplings]

Hi, great project and enjoying it so far!

I'm currently using the text-gen-web-ui API. After setting the below environments I can get the crew to kick off successfully.

os.environ["OPENAI_API_BASE"]="http://localhost:5000/v1"
os.environ["OPENAI_MODEL_NAME"]="NA"
os.environ["OPENAI_API_KEY"]="NA"

Unfortunately I need to be passing the payload JSON into that API request to tweak the temperature as well as adding the stop tokens (llama 3 repeat issue). Currently the output is corrupted by the repeating llama issue because the stop tokens can't be passed into the API.

I understand it might be using langchain as a base? Never used it and at this point I have managed to successfully avoid it like the plague in building my applications so please excuse my ignorance.