Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Total open connections reached the connection limit #979

Open
ktybursk opened this issue Jun 13, 2023 · 1 comment
Open

Total open connections reached the connection limit #979

ktybursk opened this issue Jun 13, 2023 · 1 comment

Comments

@ktybursk
Copy link

Hi,
I have noticed performance degradation when installing packages using devpi mirror. Seems to be similar to this one:
#932 . Increasing default-timeout for pip is making the job, however i can't use it in all cases (isolated flags in pip will prevent it to be working). What i've noticed in logs is that total open connections reached the limit. Is there any possibility to increase it in devpi-server configuration?

My current devpi version:

devpi-server-6.8.0
devpi-web-4.2.0

output of pip list from the virtual environment you are using.

Package       Version
------------- -------
pip           20.0.2
pkg-resources 0.0.0
setuptools    44.0.0

Provide the Python and operating system versions under which the issue occurs.
OS: Ubuntu 20.04.6 LTS (GNU/Linux 5.4.0-132-generic x86_64)
Python: 3.8.10

If possible, provide a minimal example to reproduce the issue.
The issue is probably reproduced when pip is installing in parallel from a lot of projects.
Logs:

2023-06-13 16:21:44,774 INFO  total open connections dropped below the connection limit, listening again
2023-06-13 16:21:44,783 INFO  [req38379] GET /
2023-06-13 16:21:44,806 INFO  [req38380] GET /root/pypi/+simple/tomli/
2023-06-13 16:21:44,873 WARNI Task queue depth is 45
2023-06-13 16:21:44,877 WARNI Task queue depth is 46
2023-06-13 16:21:44,878 WARNI Task queue depth is 47
2023-06-13 16:21:44,878 WARNI total open connections reached the connection limit, no longer accepting new connections
2023-06-13 16:21:44,878 WARNI Task queue depth is 48
@fschulze
Copy link
Contributor

Try this option:

      --threads THREADS     number of threads to start for serving clients. [50]

Do you have a reverse proxy in front? You get a default nginx configuration with devpi-gen-config which serves files directly instead of letting devpi-server do it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants