lucidrains / Mega-pytorch Star 202 Code Issues Pull requests Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena deep-learning artificial-intelligence exponential-moving-average attention-mechanisms long-range-arena Updated Aug 26, 2023 Python
FutureComputing4AI / Hrrformer Star 41 Code Issues Pull requests Hrrformer: A Neuro-symbolic Self-attention Model (ICML23) ember malware transformer icml self-attention lra neuro-symbolic hrr holographic-reduced-representations long-range-arena icml-2023 hrrformer Updated Jun 7, 2023 Python
lucaslingle / e-lra Star 3 Code Issues Pull requests Streamlined variant of Long-Range Arena with pinned dependencies, automated data downloads, and deterministic shuffling. transformers long-context long-range-arena Updated Jan 9, 2024 Python
FutureComputing4AI / HGConv Star 3 Code Issues Pull requests HGConv: Holographic Global Convolutional Networks ember malware transformers kaggle drebin malware-classification hrr holographic-reduced-representations long-range-arena microsoft-malware-classification-challenge Updated Feb 12, 2024 Python
hazdzz / Paramixer Star 0 Code Issues Pull requests The PyTorch implementation of Paramixer. pytorch transformer long-range-arena Updated Jun 11, 2024