Here are
5 public repositories
matching this topic...
🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记,更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
Updated
May 19, 2024
Cuda
Root Mean Square Layer Normalization
Updated
Mar 28, 2023
Python
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Updated
Apr 8, 2024
Python
Efficient kernel for RMS normalization with fused operations, includes both forward and backward passes, compatibility with PyTorch.
Updated
May 6, 2024
Python
Generative models nano version for fun. No STOA here, nano first.
Updated
May 20, 2024
Jupyter Notebook
Improve this page
Add a description, image, and links to the
rmsnorm
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
rmsnorm
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.