Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mapillary dataset validation error #4

Open
kimin-yun opened this issue Aug 16, 2023 · 0 comments
Open

mapillary dataset validation error #4

kimin-yun opened this issue Aug 16, 2023 · 0 comments
Labels
on it The issue was seen. We are working on resolving it

Comments

@kimin-yun
Copy link

Thank you for previously assisting me with the learning procedure. I'm currently experimenting with the training on RbA + Mapillary + COCO with outlier supervision. The training process seems fine and I can evaluate the trained model for Road Anomaly and Fishscape without issues. However, when I try to run validation on the Mapillary dataset in the training code, the following error occurs:

File "/home/kimin/PT-2.0/RbA/train_net_debug.py", line 378, in main
res = Trainer.test(cfg, model)
File "/home/kimin/PT-2.0/detectron2/detectron2/engine/defaults.py", line 617, in test
results_i = inference_on_dataset(model, data_loader, evaluator)
File "/home/kimin/PT-2.0/detectron2/detectron2/evaluation/evaluator.py", line 164, in inference_on_dataset
evaluator.process(inputs, outputs)
File "/home/kimin/PT-2.0/detectron2/detectron2/evaluation/sem_seg_evaluation.py", line 141, in process
).reshape(self._conf_matrix.shape)
ValueError: cannot reshape array of size 415 into shape (20,20)

Occasionally, instead of 415, a different number appears. I suspect there's an issue with computing the 20x20 confusion matrix in semantic segmentation. Is there any specific configuration I need to set for the Mapillary dataset? Given that the results from my training are quite similar to the provided model, I believe the dataloader isn't the issue. If you have any insights or suspect areas, I'd appreciate your assistance.

@NazirNayal8 NazirNayal8 added the on it The issue was seen. We are working on resolving it label Aug 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
on it The issue was seen. We are working on resolving it
Projects
None yet
Development

No branches or pull requests

2 participants