-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
(Maybe) in-consistency between VQ-VAE paper and its implementation. #252
Comments
Probably, That is my new understanding. |
please close this if admin thinks this explanation is right. |
FIrst of all, maybe it is my misunderstanding of the paper, so hope somebody could explain it for me, thanks! :
in the paper, the loss is defined as
where
e
is the codebook defined at the beginning of the Section:So, in the paper, the codebook loss and commitment loss are MSE between
z_e(x)
ande
.However, in the implementation, they are implemented as MSE between
z_e(x)
(inputs) andz_q(x)
(quantized), where variable quantized means quantized encoding of the image, namelyz_q
:Are they actually the same thing? why?
z_e(x)
(H' * W' * D) ande
(K * D)?z_q(x)
(quantized) backprop since its calculation contains argmin?The text was updated successfully, but these errors were encountered: