In server mode, can we stop generating (like in chat UI there's stop generating button)

[x4080]

In server mode, can we stop generating (like in chat UI there's stop generating button)

Any idea ?

Thanks

[shibe2]

When using streaming completion, close the HTTP connection. It stops generation, but it doesn't seem to stop prompt processing.

[teleprint-me]

It stops generation, but it doesn't seem to stop prompt processing.

Yeah, this is something I ran into as well. It is possible to interrupt it completely. Not sure how to signal that in the browser.

[x4080]

@shibe2 Thanks