Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to profile long running application ? #92

Open
eromoe opened this issue Jun 25, 2019 · 2 comments
Open

How to profile long running application ? #92

eromoe opened this issue Jun 25, 2019 · 2 comments
Labels

Comments

@eromoe
Copy link

eromoe commented Jun 25, 2019

Hello,

I have a project need multiprocessing and would take over 4 hour in a 36cores vps .
My local machine is windows, has some problem to run mprof .

So I run vprof -c cmh "run.py salecount -n 1" --output-file profile.json on a remote vps .
Because vprof didn't support multiprocessing , I can't wait it done .
Abort from execution, it didn't export any files .

What is the correct way in my case ??

@eromoe eromoe changed the title How to profile long running application , I don' t want to wait . How to profile long running application ,I don' t want to wait . Jun 25, 2019
@eromoe eromoe changed the title How to profile long running application ,I don' t want to wait . How to profile long running application ? Jun 25, 2019
@nvdv nvdv added the question label Jun 25, 2019
@nvdv
Copy link
Owner

nvdv commented Jun 25, 2019

I would suggest running your program on smaller input if it's possible.

@TeamSpen210
Copy link

You don't need to run your full application. Comment out code and tweak the main loop so it runs the program directly instead of multiprocessing, and runs on say a quarter of the data you're using. You're looking for the functions taking high proportions of time, not the exact full runtime.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants