Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: bf16 kernels #1651

Open
2 tasks
Tracked by #1813
eddyxu opened this issue Nov 21, 2023 · 0 comments · May be fixed by #1664
Open
2 tasks
Tracked by #1813

perf: bf16 kernels #1651

eddyxu opened this issue Nov 21, 2023 · 0 comments · May be fixed by #1664
Assignees
@rok
Labels
benchmark performance rust Rust related tasks vector Vector Search

Comments

@eddyxu
Copy link
Contributor

eddyxu commented Nov 21, 2023

Provide bf16 kernels of L2 / Dot / Cosine

  • Benchmark of bf16 kernels
  • make sure it is appropriately vectorized with avx512bf16 or on Apple M2/M3 with NEON_BF16 flags.
@eddyxu eddyxu added benchmark rust Rust related tasks vector Vector Search performance labels Nov 21, 2023
@rok rok linked a pull request Nov 27, 2023 that will close this issue
Draft
@rok rok linked a pull request Nov 27, 2023 that will close this issue
perf: bf16 kernels #1664
Draft
@wjones127 wjones127 mentioned this issue Jan 10, 2024
Open
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rok rok

Labels
benchmark performance rust Rust related tasks vector Vector Search
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

perf: bf16 kernels rok/lance
2 participants
@eddyxu @rok