Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the reproducibility #1

Open
xizero00 opened this issue Aug 15, 2022 · 1 comment
Open

About the reproducibility #1

xizero00 opened this issue Aug 15, 2022 · 1 comment

Comments

@xizero00
Copy link

Hi,
Thanks for sharing this great work.
I retrained the poseur_res50_coco_256x192 model and got AP=73.0
The AP result is lower than the AP=75,4 in Table 2 (a)
How can I get the result in the paper?
Thanks a lot!

[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 104128/104125, 2139.4 task/s, elapsed: 49s, ETA:     0s

Loading and preparing results...
DONE (t=5.50s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *keypoints*
DONE (t=9.69s).
Accumulating evaluation results...
DONE (t=0.32s).
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=   all | maxDets= 20 ] =  0.730
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets= 20 ] =  0.889
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets= 20 ] =  0.798
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets= 20 ] =  0.695
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets= 20 ] =  0.796
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 20 ] =  0.784
 Average Recall     (AR) @[ IoU=0.50      | area=   all | maxDets= 20 ] =  0.930
 Average Recall     (AR) @[ IoU=0.75      | area=   all | maxDets= 20 ] =  0.844
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets= 20 ] =  0.741
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets= 20 ] =  0.847
2022-08-14 04:06:17,317 - mmpose - INFO - The previous best checkpoint /home/dx/projects/Poseur/work_dirs/poseur_res50_coco_256x192/best_AP_epoch_300.pth was removed
2022-08-14 04:06:18,256 - mmpose - INFO - Now best checkpoint is saved as best_AP_epoch_325.pth.
2022-08-14 04:06:18,257 - mmpose - INFO - Best AP is 0.7298 at 325 epoch.
2022-08-14 04:06:18,269 - mmpose - INFO - Epoch(val) [325][407] AP: 0.7298, AP .5: 0.8890, AP .75: 0.7979, AP (M): 0.6954, AP (L): 0.7964, AR: 0.7840, AR .5: 0.9304, AR .75: 0.8438, AR (M): 0.7406, AR (L): 0.8470
@YongtaoGe
Copy link
Collaborator

Hi, @xizero00 pls use the --cfg-options model.filp_fuse_type='type2' when evaluation, e.g.

./tools/dist_test.sh configs/body/2d_kpt_sview_rgb_img/poseur/coco/poseur_r50_coco_256x192.py \
    poseur_256x192_r50_6dec_coco.pth 8 \
    --eval mAP \
    --cfg-options model.filp_fuse_type=\'type2\'

If the results are still lower than the paper, pls let me know and I will check the code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants