Skip to content

This machine learning project explores developing a Word2Vec model for NLP of claims and evidences found in the Climate Fever dataset from the Hugging Face AI community. Spatial relationships in the embedding matrix are investigated using cosine similarity, and its quality is compared with pretrained GloVe and Word2Vec models.

Notifications You must be signed in to change notification settings

subramario/Climate_Fever_NLP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 

Repository files navigation

Natural Language Processing

This project explores developing a Word2Vec model for NLP using the Climate Fever dataset from the Hugging Face AI community. The Word2Vec model is trained to generate an embedding matrix, and its spatial relationships are investigated using cosine similarity. The quality of the embeddings are examined by exploring arithmetic relationships between similar and dissimilar words. The model is then compared with two pretrained models (1 Word2Vec using Google News 300 dataset, 1 GloVe trained using a combination of a Wikipedia dataset and the Gigaword dataset). All models are compared to evaluate the quality of embeddings within their respective matrices.

Arithmetic Relationship Example

Nasa + Scientist = Laboratory

About

This machine learning project explores developing a Word2Vec model for NLP of claims and evidences found in the Climate Fever dataset from the Hugging Face AI community. Spatial relationships in the embedding matrix are investigated using cosine similarity, and its quality is compared with pretrained GloVe and Word2Vec models.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published