-
Notifications
You must be signed in to change notification settings - Fork 607
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Extract motion vectors #5363
Comments
Hi @rvandeghen, Thank you for reaching out. As far as I understand NVDEC doesn't expose this info and it is impossible to do that in DALI. What you can do instead is use the 'optical flow' operator. |
@JanuszL thanks for the reply. Do you know how to return both list of frames and list of OF ? I have an error which I guess comes from the fact that The code I use is the following:
Error:
|
Hi @rvandeghen, I think your pipeline returns more than the iterator consumes. Can you try:
|
Hi @JanuszL, Indeed the optical flow gives good results at barely no extra cost. However, I found in the blogpost the following information and I would like to know if DALI exposes this buffer ?
Renaud |
Hi @rvandeghen, Currently, the operator doesn't ask the Optical Flow SDK to provide such values.
|
Hi @JanuszL, Do you know if I should expect huge/small changes in the output depending on the value I set to I did some comparisons between the NVIDIA OF and RAFT (torchvision version: https://pytorch.org/vision/main/models/raft.html) and the output was much smoother with RAFT. I also found that changing the value of FYI, I'm using a A100 and my OF is defined as:
Is it the correct behavior ? I know that you are not directly related to NVOF, so if you know someone relevant to answer my questions, do not hesitate to share it with me. |
Hi @rvandeghen, To my knowledge, the behavior of NVIDIA OF depends on the driver version and the GPU available. It is probably best to ask on the NVIDIA forum. |
Describe the question.
Hello,
I was wondering if there is a way to obtain the motion vectors you compute when you decode a video on GPU?
Thanks
Check for duplicates
The text was updated successfully, but these errors were encountered: