Rishit-dagli / Nystromformer Sponsor Star 56 Code Issues Pull requests Discussions An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention machine-learning deep-learning tensorflow keras artificial-intelligence transformer attention-mechanism nystrom nystromformer Updated Aug 21, 2022 Python
LennartKeller / roberta2longformer Star 9 Code Issues Pull requests Convert pretrained RoBerta models to various long-document transformer models nlp transformers pytorch language-model roberta huggingface longformer huggingface-transformers roberta-model longformer-models big-bird nystromformer Updated Apr 5, 2022 Python