Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Milestone] Refactoring data structure tracker #2691

Open
shijianjian opened this issue Dec 18, 2023 · 2 comments
Open

[Milestone] Refactoring data structure tracker #2691

shijianjian opened this issue Dec 18, 2023 · 2 comments
Assignees
Labels
enhancement 🚀 Improvement over an existing functionality help wanted Extra attention is needed
Milestone

Comments

@shijianjian
Copy link
Member

shijianjian commented Dec 18, 2023

Bounding boxes refactoring to note about:

  1. Apart from coordinates, we need to add rotated angles into our current design.
  2. Similar to Keypoints not properly transformed through Augmentations #2684, there is a need to filter bounding boxes after certain transformation. This feature includes:
    • shrink the coordinates as per the image size. Then
    • remove boxes out of the image after transformations.
    • remove boxes according to a threshold (maybe a percentage of the image or the area).

Mask refactoring:

  1. support list of masks as input. Support list of masks in AugmentationSequential #2421 is working on it but turns to be stale now.

Some more ideas may be suggested.


Note that we currently using polygon format for all the bounding boxes. Essentially, this format allows more accurate point locations after image transformations. E.g. a perspective transformation. However, it is not easy to decide how to smoothly transit from the "accurate" polygon format to the popular "XYXY(rot)" or "XYWH(rot)" formats.

@shijianjian shijianjian added the help wanted Extra attention is needed label Dec 18, 2023
@edgarriba
Copy link
Member

@edgarriba edgarriba added this to the kornia 0.7.3 milestone Dec 19, 2023
@edgarriba edgarriba added the enhancement 🚀 Improvement over an existing functionality label Dec 19, 2023
@edgarriba edgarriba pinned this issue Dec 19, 2023
@edgarriba edgarriba changed the title [Feature] Refactoring data structure tracker [Milestone] Refactoring data structure tracker Dec 19, 2023
@johnnv1
Copy link
Member

johnnv1 commented Dec 20, 2023

link to #2064

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement 🚀 Improvement over an existing functionality help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants