Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About hit radio@50 in the evaluation of AttRec #31

Open
blcunlp opened this issue May 27, 2020 · 1 comment
Open

About hit radio@50 in the evaluation of AttRec #31

blcunlp opened this issue May 27, 2020 · 1 comment

Comments

@blcunlp
Copy link

blcunlp commented May 27, 2020

hi,
In the evaluation process of AttRec, when calculating the recommendation item rank of each user, why use the negative items instead of all items?
this code in: DeepRec/utils/evaluation/SeqRecMetrics.py--->def evaluate1(self)
image

In my understanding, It should be to calculate the score of each user and all items, then rank them, and finally take the top 50 to calculate HT@50.

Calculate it the way the code says, it does not have any positive items in the prediction process.

@cheungdaven
Copy link
Owner

Usually, we only consider recommending those items that the user has never seen. If an item is liked by the user, we don't want to repeatedly recommend it to him.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants