Implementation of A Structured Self-Attentive Sentence Embedding by Lin et al., 2017 with my own words embedding from an implementation of the W2V CBOW algorithm.
The implementation is performed on a part of Yelp reviews, availables here.
Here are partial results of the implementation with 3 attention heads. Highlighted words are considered as the most importants by the attention head to predict the rating. (Please keep in mind that the whole computing was executed with unoptimized materials. Results can be improved)
First review :
Second review :
