Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The panoramic view is not stiched well (first and last image are looking up or down with non-zero elevation)! #110

Open
lukewenMX opened this issue May 24, 2022 · 4 comments

Comments

@lukewenMX
Copy link

The generated panoramic view from the skybox images is not stiched well by runing the downsize_skybox.py, that is the <pano.id>_skybox_small.jpg is not an accurate panoramic view especially for the first and last images (one is looking up and one is looking down with an non-zero elevation) . An instance has been shown in below, please give some comments and suggestions, thanks.
0b22fa63d0f54a529c525afbf2e8bb25_skybox_small

@peteanderson80
Copy link
Owner

This is working as intended. The image is a skybox / cubemap not an equirectangular panorama, so it's actually 6 different images representing the faces of a cube and they are just joined together for convenience (it speeds up file loading to have fewer and larger files).

@lukewenMX
Copy link
Author

@peteanderson80 Hi, Peter. Thanks for your sharp reply and the answer really helps me. By the way, do you have any ideas about how to generate the 'equirectangular panorama' shown as perfectly stiched together? I did not find any program which supports to load the well-trained agent to interact with Matterport 3D simulator and at the meantime showing the "equirectangular panorama" . Will appreciate your further answers and any suggestions.
Thank again.

@lukewenMX
Copy link
Author

@peteanderson80 Hi, Peter. I think I just got the idea of the skybox, and the question about the equirectangular panorama,please just ignore. Many thanks.

@lukewenMX
Copy link
Author

By the way, is there any convenient way to show the traversed path by the agent from the top-down view of the simulated house, as dipicted below (Picture from the published paper reference: Li, Xiujun, Chunyuan Li, Qiaolin Xia, Yonatan Bisk, Asli Celikyilmaz, Jianfeng Gao, Noah Smith, and Yejin Choi. "Robust navigation with language pretraining and stochastic sampling." arXiv preprint arXiv:1909.02244 (2019).):
path visualization from TOP
Many thanks in advance for any help and suggestions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants