Skip to content

v1.0.0
Compare
Choose a tag to compare
@laekov laekov released this 02 Apr 03:11
· 91 commits to master since this release
v1.0.0
59bcec8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

FasterMoE

  • The new performance boosting features in the PPoPP'22 paper FasterMoE, detailed in the document.
    • Expert Shadowing.
    • Smart Scheduling.
    • Topology-aware gate.

Bug fixes

  • Transformer-XL examples.
  • Compatibility to PyTorch versions.
  • Megatron-LM documents.
  • GShardGate.
Assets 2