Access to SimState.rgb when displayer is not applicable

[daoyuan98]

Hi, I am running this simulator on a server without a display device. I want to get the scene image via SimState.rgb. But I got an error which says as follows:
TypeError: Unable to convert function return value to a Python type! The signature was (self: MatterSim.SimState) -> object
I think this probably may be related to the disconnection to a display device. Therefore, may I ask:

1. Can I access the rgb image without a display device?

• Some research codes setRenderngEnabled=False by not openning this simulator. But in this way the same error information occurs.

2. Is it possible to access the images without downloading the whole 1.3T data?

• I am downloading the dataset to a computer with a display but the speed is too slow...

Thanks and I do look forward to your reply!

[krtin]

@daoyuan98 were you able to find a solution for the issue?

[daoyuan98]

@daoyuan98 were you able to find a solution for the issue?

Unfortunately, no

[TommeyChang]

Your problem seems like curious. @daoyuan98
I have the 1.3T data, if I unmounted the HD and set setRenderngEnabled=True, the error was "unable to open skybox files".
However, if I set setRenderngEnabled=False, no matter what status the HD was, the error was the same as yours.
Thus, I think the problem is caused by the dataset, not the display.

[RunweiSitu]

So how can we access the image of viewpoints via state.rgb? Has anyone found a solution yet?

[neo99zhang]

@daoyuan98 were you able to solve this? got the exactly same error but I was working on wsl2.

[daoyuan98]

@daoyuan98 were you able to solve this? got the exactly same error but I was working on wsl2.

unable to solve this..