Response stops streaming

[sam1am]

What happened?

Frequently when a model response is streaming, the UI seems to stop updating and get stuck. I believe the streaming is still happening in the background because if you wait for it to finish and refresh the page, the response will be there.

Steps to Reproduce

1. This seems to happen regardless of language model provider.
2. I am using Firefox, which may be relevant.

What browsers are you seeing the problem on?

Firefox

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Issues like this seem to be a network connectivity issue between the UI and backend, or between the backend and the remote service.

It can't be reliably reproduced, unless I introduce throttling to the network.

[danny-avila]

For example, this is my remote instance and it's not having this issue:

response.recording.mp4

[fuegovic]

It is very hard to reproduce, some endpoints seem to do it more often then others... It was mentionned at least once on discord:
discord #general