New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
VQA: Limitations in questions and answers #25
Comments
Hi, you need to modify the inference process of the VQA model. do not use this to rank the candidate answers: https://github.com/zengyan-97/X-VLM/blob/master/models/model_vqa.py#L144 instead, you should make it a real generation. for example, you can refer to: https://github.com/zengyan-97/X-VLM/blob/master/models/model_captioning.py#L75 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I want my Finetuned VQA model to be able to answer questions is was not trained on before and similarly provides answers that does not exist in the original answer list (test json file answers in a list).
Is there a limitation to the kind of questions i can the model? If yes, how can I tweak the code to meet my needs?
The text was updated successfully, but these errors were encountered: