-
Notifications
You must be signed in to change notification settings - Fork 47
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
worker-short-running is a memory hog #1824
Comments
so that we can experiment with it. Related packit#1824
thank you for creating this, was about to do the same :D I stumbled upon Memory leak in run Celery Django, Gevent strategy with Multi Worker but it doesn't seem related: I couldn't find any warning in the celery startup. |
Install eventlet in worker so that we can experiment with it. Related #1824 Reviewed-by: Tomas Tomecek <[email protected]> Reviewed-by: Matej Focko <None>
I tried the F37 contains celery-5.3.0b1, while F35 had celery-5.2.6 so I built a worker image with 5.2.6 from PyPI (rpm can't be installed because of dependencies) and I'm running it on |
gevent from PyPI pulls in greenlet>2.0.0 which fixes https://bugzilla.redhat.com/show_bug.cgi?id=2158732 We can't pip install only greenlet>2 because $ rpm -q --requires python3-gevent python3.11dist(greenlet) < 2~~ Fixes packit#1824 And remove python3-eventlet temporarily readded with 3c8f66f
gevent from PyPI pulls in greenlet>2.0.0 which fixes https://bugzilla.redhat.com/show_bug.cgi?id=2158732 We can't pip install only greenlet>2 because $ rpm -q --requires python3-gevent python3.11dist(greenlet) < 2~~ Fixes packit#1824 And remove python3-eventlet temporarily readded with 3c8f66f
Pip-install gevent & greenlet gevent from PyPI pulls in greenlet>2.0.0 which fixes RHBZ#2158732 (Memory leak with Python 3.11) We can't pip install only greenlet>2 because $ rpm -q --requires python3-gevent-0:21.12.0-4.fc37.x86_64 python3.11dist(greenlet) < 2~~ Fixes #1824 And remove python3-eventlet temporarily readded with 3c8f66f EDIT: Looks OK on staging. Reviewed-by: Tomas Tomecek <[email protected]>
After bumping our base image to F37, the
worker-short-running
leaks memory and is periodically OOMKilled and restarted.The
worker-long-running
is OK so it's just the multi-threaded one.We can try the other thread pool, i.e.
eventlet
instead ofgevent
.We can also experiment with setting some options, but they seem to be supported only by the
prefork
pool.Also read through celery/celery#4843 (EDIT: that seems to apply only to
prefork
pool andRabbitMQ
broker)The text was updated successfully, but these errors were encountered: