a 2D cosine attention module inspired by cosFormer: Rethinking Softmax in Attention(https://arxiv.org/abs/2202.08791)
-
Updated
Mar 13, 2022 - Python
a 2D cosine attention module inspired by cosFormer: Rethinking Softmax in Attention(https://arxiv.org/abs/2202.08791)
Add a description, image, and links to the cosformer topic page so that developers can more easily learn about it.
To associate your repository with the cosformer topic, visit your repo's landing page and select "manage topics."