Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training Time #12

Open
Alice-302 opened this issue Apr 17, 2024 · 3 comments
Open

Training Time #12

Alice-302 opened this issue Apr 17, 2024 · 3 comments

Comments

@Alice-302
Copy link

Excuse me about how long the training cycle is?

@happy-hsy
Copy link
Collaborator

We implement a two-stage training process. In Stage 1, we train using Objects365, and in Stage 2, we use a combination of Objects365, OpenImages, and V3Det. Each stage requires approximately 12-15 hours to complete 450,000 iterations.

@Alice-302
Copy link
Author

Alice-302 commented May 13, 2024

Hi, @happy-hsy

  1. Excuse me, do I need to download the OpenImages, and V3Det data completely? I saw that these two data sets are quite large. For example: The OpenImages data set introduction has 561GB. Do I need to download a subset of the images or do I need to download all of them. And currently I only have two cards to train with, will it take a long time to train?

@happy-hsy
Copy link
Collaborator

Thank you for your interest. I recommend downloading all the data for training to achieve the best performance. However, if storage is a constraint, you can use a portion of the OpenImages dataset for training, though this may result in decreased performance. We have not tested this approach. Regarding training time, we have not conducted training using only two parts of the dataset, and it may require many iterations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants