Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]:: xFormers can't load C++/CUDA extensions. #497

Open
txmu opened this issue Mar 2, 2024 · 0 comments
Open

[Bug]:: xFormers can't load C++/CUDA extensions. #497

txmu opened this issue Mar 2, 2024 · 0 comments

Comments

@txmu
Copy link

txmu commented Mar 2, 2024

What happened?

NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs: query : shape=(2, 4096, 8, 40) (torch.float16) key : shape=(2, 4096, 8, 40) (torch.float16) value : shape=(2, 4096, 8, 40) (torch.float16) attn_bias : <class 'NoneType'> p : 0.0 `flshattF` is not supported because: xFormers wasn't build with CUDA support Operator wasn't built - see `python -m xformers.info` for more info `tritonflashattF` is not supported because: xFormers wasn't build with CUDA support requires A100 GPU Only work on pre-MLIR triton for now `cutlassF` is not supported because: xFormers wasn't build with CUDA support Operator wasn't built - see `python -m xformers.info` for more info `smallkF` is not supported because: xFormers wasn't build with CUDA support dtype=torch.float16 (supported: {torch.float32}) max(query.shape[-1] != value.shape[-1]) > 32 Operator wasn't built - see `python -m xformers.info` for more info unsupported embed per head: 40
Time taken: 0.9 sec.

A: 2.41 GB, R: 2.93 GB, Sys: 3.1/14.749 GB

I ran the nightly SD then it appeared

Colab cell output

WARNING:xformers:WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFo

Which colab and model(s) were you using when the error occurred?

sd

Which Public WebUI Colab URL were you using when the error occurred?

gradio.live

If you used HiRes mode when the error occurred, please provide the Hires info

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant