New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cross lingual IR #31

Open

krrishdholakia opened this issue May 4, 2023 · 1 comment

krrishdholakia commented May 4, 2023

Hi,

how can i use this to do cross-lingual IR? for eg. if the user query is in portugese and the corpus is in english?

Author

krrishdholakia commented May 4, 2023

an idea i had was to use the gpt2tokenizer but i wasn't sure how to use that alongside bm25 which is keyword based.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment