Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Driving pose skeleton to approximate the length of the character’s skeleton in the reference image #62

Open
learnuser1 opened this issue Jan 26, 2024 · 8 comments

Comments

@learnuser1
Copy link

During inference, we rescale the length of the driving pose skeleton to approximate the length of the character’s
skeleton in the reference image. Does anyone know how to do this step?

@mymusise
Copy link

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

@learnuser1
Copy link
Author

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

I tried scaling the skeleton and it worked, but it wasn't good enough.

@MoonEese
Copy link

MoonEese commented Feb 5, 2024

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

@wangxr1999
Copy link

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

@wxhqw
Copy link

wxhqw commented Feb 23, 2024

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

It's so greatly, i have some doubts, how to select the key points?

@eightmusic
Copy link

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

How did you achieve it? Can you share the code.

@wweevv-johndpope
Copy link

@eightmusic - there's this code base - https://github.com/MooreThreads/Moore-AnimateAnyone/

@EnochX
Copy link

EnochX commented Mar 12, 2024

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

That's so great. Really want to know how to make it! Can you share the code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants