You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Could you please point me to relevant documentation related to deriving pool size if available else please provide some suggestion on the same.
Environment Details:
Three fission environments (python)
Multiple models/python code that run in one of the fission environment.
Fission is running in pool manager mode.
Current pool size is 3.
Concurrency is set to default 500
Sometime due to lot of concurrent requests, we see some errors like "error posting to getting service for function: context deadline exceeded". We increased the pool size to 5 and now occurrence of this errors is reduced.
So i would like to now how should we arrive at ideal pool size.?
I am assuming if pool size is 3 and if 4 concurrent requests are received for a model using that environment, 3 pods will be specialized first while fission is trying to make 3 additional pods available in pool. While this is happening 4th req will wait until specialize timeout?
This discussion was converted from issue #2429 on June 10, 2022 06:18.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi All,
Could you please point me to relevant documentation related to deriving pool size if available else please provide some suggestion on the same.
Environment Details:
Sometime due to lot of concurrent requests, we see some errors like "error posting to getting service for function: context deadline exceeded". We increased the pool size to 5 and now occurrence of this errors is reduced.
So i would like to now how should we arrive at ideal pool size.?
Any help is greatly appreciated.
Beta Was this translation helpful? Give feedback.
All reactions