Welcome to BlenderProc Discussions!

[themasterlink]

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you:

• Ask questions you’re wondering about.
• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

[VishalBalaji321]

Hey guys, I am just starting to use BlenderProc for dataset generation and found it quite resourceful so far. The project I am working on, requires Keypoint data from certain objects in the scene, apart from Semantic Segmentation and Depth. Is there anyway to possible to retrieve keypoint data as well using BlenderProc?

Thanks in Advance

[cornerfarmer]

You can take a look at #134, however the code there is a bit outdated.

Here is how you would save the pixel coordinates of every vertex of the object Cube.001:

import bpy, bpy_extras
import numpy as np
from mathutils import Vector
width = 512
height = 512
keypoints = []
for frame_id in range(bproc.utility.num_frames()):
    bpy.context.scene.frame_set(frame_id)

    keypoints_per_frame = []
    for vert in cube.get_mesh().vertices:
        vert_world = (cube.get_local2world_mat() @ np.append(vert.co, 1))[:3]
        point2d_blender = bpy_extras.object_utils.world_to_camera_view(bpy.context.scene, bpy.context.scene.camera, Vector(vert_world))
        keypoints_per_frame.append([point2d_blender[0] * width, (1 - point2d_blender[1]) * height])

    keypoints.append(keypoints_per_frame)
data["key_points"] = keypoints

The code is added after rendering, so you can add the keypoints directly to the data dict.
You can of course also do the same for other 3D points than vertices.

[danbenos]

Trivial question, if I wanted to run the examples in the documentation, I need to clone the GitHub project, i.e. it is not enough to just install with "pip install blenderproc", am I correct?

I have installed using "pip install blenderproc" as documented. However, if I read the Basic Scene example, this installation does not include the "BlenderProc main directory" that contains the examples folder. So I will still need to clone / download the project.

In the same vein, "blenderproc quickstart" as indicated in the GitHub main page does not exist. The documentation front page however is correct in explaining that we need to create the quickstart.py ourselves.

[themasterlink]

I have installed using "pip install blenderproc" as documented. However, if I read the Basic Scene example, this installation does not include the "BlenderProc main directory" that contains the examples folder. So I will still need to clone / download the project.

Exactly, the examples can only be used if you first git clone the project.

In the same vein, "blenderproc quickstart" as indicated in the GitHub main page does not exist. The documentation front page however is correct in explaining that we need to create the quickstart.py ourselves.

That is a current bug, if you pip install the current main version it should work, we need to release a new pip version, we haven't had time to do that, yet.

[danbenos]

I see. Is there a way for me to install this unreleased version?

[MartinSmeyer]

Just follow the steps here:
https://github.com/DLR-RM/BlenderProc#git-clone

[danbenos]

When reading the example for the dataset SceneNet, texture files are required and the download link is http://tinyurl.com/zpc9ppb. This leads to a google drive page where access is denied, with a button and message to request access. Are you (the maintainers here) the owner of these texture files or is it owned by the maintainer of SceneNet? Is this free to request, and what message should I put here?

[themasterlink]

Hey,

the data link is from here: https://github.com/ankurhanda/SceneNetv1.0

We do not host the data ourselves. Just ask to access for the data, Ankur is a nice guy and will grant you access. Apparently he changed the access rights to the file.

PS: I added an issue to request that it goes public again: ankurhanda/SceneNetv1.0#7

Best,
Max

[danbenos]

Oh so it used to be public. Alright then, I will just send request and hope for the best. Thanks for the information

[themasterlink]

That is the new link: https://drive.google.com/file/d/0B_CLZMBI0zcuQ3ZMVnp1RUkyOFk/view?usp=sharing&resourcekey=0-w8JN2r3WQ48eZltxQ-fSwA

He changed made it public for us again.

[themasterlink]

This is also fixed in the readme now: b448927

Thanks again for making us aware of this.

[MayconSilva7]

Hey guys. Look, I have installed Blender by pip install blenderproc and I have clone GitHub project, the command from documentation. But, when I run the quickstart example, Blender says "no module name blenderproc". But the all files are in the same directory. I don't understand. Besides, the Blender Proc main hasn't been installed.

[MartinSmeyer]

It seems bproc.init() also calls set_render_devices()

Could you replace it with set_render_devices(use_only_cpu=True) as well here:

File "C:\Program Files\Python310\lib\site-packages\blenderproc\python\utility\Initializer.py", line 42, in init
RendererUtility.set_render_devices()

I agree that we should fix our CPU only behavior.. There is already an open issue #723

[MartinSmeyer]

actually #723 was already solved by PR #740. You are just not using the latest version of BlenderProc. I assume you did not install blenderproc via pip install blenderproc but via the github repo. Just make sure to run BlenderProc 2.5 by pulling the latest version

[MayconSilva7]

I am using blenderproc 2.5. Look that:
PS C:\Program Files> blenderproc -v
2.5.0
PS C:\Program Files>

[MartinSmeyer]

Oh, I see, sorry. The change here was after we released BlenderProc 2.5:

4fe2f3a

So you need to uninstall blenderproc again, and follow the git instructions here to install the most recent main branch.

[MartinSmeyer]

(The fix above also works of course)

[MayconSilva7]

I got it, thank you very much. I did what you said. I removed bproc.init(), and I've wrote set_render_devices (use_only_cpu=True) and Initializer.py and quickstar.py.

Merging data for frame 249 into output/249.hdf5
Merging data for frame 250 into output/250.hdf5
PS C:\Program Files> blenderproc vis hdf5 output/1.hdf5
output/1.hdf5:
Keys: 'colors': (1080, 1920, 3).

Thank you very much.

[MayconSilva7]

Basic example. Where can I download the obj and camera file from basic example? I've tried through terminal, but I can't.

I am sorry the basic questions, I've used Blender through python , but I'm starting with blenderproc and basic with python.

[cornerfarmer]

They are included in the blenderproc repository: https://github.com/DLR-RM/BlenderProc/tree/main/examples/resources

[cornerfarmer]

Please, in the future open a new discussion thread for your questions.