-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
opportunities to improve cpu performance? #240
Comments
Have you tested gnu parallell? https://www.gnu.org/software/parallel/ Use tmpfs to get the best performance. |
Can you expand on your suggestion. I don't think that the local filesystem is the bottleneck here because it was getting used at both ends of the transfer both with |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I had the (I thought inspired) but (obvious given the context here) idea of using
cpu
to mount a selection of pre-built binary tools into a GCP node rather than installing them or building an archive or such not. But performance is insufficient for this use case.While Internet bandwidth is definitely a very significant part of this, I did some benchmarking and believe that
cpu
itself could be more performant.The text was updated successfully, but these errors were encountered: