Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

replaced call to _prepare_decoder_attention_mask() with _prepare_4d_causal_attention_mask() #545

Draft
wants to merge 11 commits into
base: main
Choose a base branch
from
Draft

replaced call to _prepare_decoder_attention_mask() with _prepare_4d_causal_attention_mask() #545

wants to merge 11 commits into from

Commits on Nov 22, 2023

  1. replaced call to _prepare_4d_causal_attention_mask

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    76479fd View commit details
    Browse the repository at this point in the history

  2. upped transformers ver to 4.35

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d315467 View commit details
    Browse the repository at this point in the history

  3. upd Bloom _prepare_attn_mask()

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    c6db638 View commit details
    Browse the repository at this point in the history

  4. mask to bool for bloom fwd

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    2bdbf2d View commit details
    Browse the repository at this point in the history

  5. Llama rotary dims from 4 to 2

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    fa254cf View commit details
    Browse the repository at this point in the history

  6. past_key_values to None if zero shape

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    741b539 View commit details
    Browse the repository at this point in the history

  7. _prepare_4d_causal_attention_mask in tests

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3810049 View commit details
    Browse the repository at this point in the history

  8. attn_mask fixes for falcon

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    e5a3fe6 View commit details
    Browse the repository at this point in the history

  9. llama block reformatted

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    bd0ca0f View commit details
    Browse the repository at this point in the history

  10. edits to bloom, falcon inputs_embeds arg

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    5aebd3e View commit details
    Browse the repository at this point in the history

  11. black

    @younesbelkada
    younesbelkada committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    401e791 View commit details
    Browse the repository at this point in the history