Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory leak in the training code #121

Open
cckamiya opened this issue Aug 28, 2023 · 1 comment
Open

memory leak in the training code #121

cckamiya opened this issue Aug 28, 2023 · 1 comment

Comments

@cckamiya
Copy link

There is a memory leak in the training code of AdaPoinTr_PCN model when I train my own model, and my training memory of more than 2200epoch can occupy about 40G+.By the memory, I don't mean the graphics memory of the graphics card, but the memory of the computer.

@yuxumin
Copy link
Owner

yuxumin commented Aug 28, 2023

Hey @cckamiya, it appears that we're saving the picture during each validation here. If you believe the visualization in TFBorad isn't needed, go ahead and comment out this section of the code to see if it resolves the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants