Skip to content

Pull requests: vllm-project/vllm

New pull request New
223 Open 1,634 Closed
223 Open 1,634 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Misc] Logits processor plugins
#4769 opened May 11, 2024 by NadavShmayo Loading…
[Kernel] sliding window support in paged_attention_v1/v2 kernels
#4768 opened May 11, 2024 by mmoskal • Draft
[Misc]Easier access to the nccl library
#4767 opened May 11, 2024 by Cyuchuan Loading…
[Bugfix] Fix call to init_logger in openai server
#4765 opened May 11, 2024 by NadavShmayo Loading…
[Core][Bugfix]: fix prefix caching for blockv2
#4764 opened May 11, 2024 by leiwen83 Loading…
1
[CI/Build] Enable entrypoints tests to be run in a single command
#4759 opened May 11, 2024 by DarkLight1337 Loading…
[Frontend] Re-enable custom roles in Chat Completions API
#4758 opened May 11, 2024 by DarkLight1337 Loading…
1
[Core][Distributed] add fast broadcast for tensor dict
#4757 opened May 11, 2024 by youkaichao Loading…
1 task
3
[Core][Distributed] refactor custom allreduce to support multiple tp groups
action-required
#4754 opened May 10, 2024 by youkaichao Loading…
1 task
12
Support fp8 KV cache in context_attention_fwd
#4753 opened May 10, 2024 by Yard1 • Draft
Add TensorizerArgs to client api server
#4752 opened May 10, 2024 by vrdn-23 Loading…
2
[Misc] Enhance attention selector
#4751 opened May 10, 2024 by WoosukKwon Loading…
[Kernel] Add w8a8 CUTLASS kernels
#4749 opened May 10, 2024 by tlrmchlsmth • Draft
[CI/Build] use setuptools-scm to set __version__
#4738 opened May 10, 2024 by dtrifiro Loading…
1
[Speculative decoding] Improve n-gram efficiency
#4724 opened May 9, 2024 by comaniac Loading…
25
[CI/Build] Enforce style for C++ and CUDA code with clang-format
#4722 opened May 9, 2024 by mgoin Loading…
@rkooo567
3
[Misc] Added devcontainer to help vscode dev setup
#4720 opened May 9, 2024 by ElefHead Loading…
[CORE] Improvement in ranks code
#4718 opened May 9, 2024 by SwapnilDreams100 Loading…
1
[CI/Build] Tweak Marlin Nondeterminism Issues
#4713 opened May 9, 2024 by robertgshaw2-neuralmagic Loading…
2
add TypeLogitsProcessor
#4712 opened May 9, 2024 by eitanturok • Draft
[Doc] Add API reference for offline inference
#4710 opened May 9, 2024 by DarkLight1337 Loading…
1
1
[Core][Hash][Automatic Prefix caching] Accelerating the hashing function by avoiding deep copies
#4696 opened May 8, 2024 by KuntaiDu Loading…
21
Remove Ray health check
#4693 opened May 8, 2024 by Yard1 Loading…
1
[Core] Implement sharded state loader
#4690 opened May 8, 2024 by aurickq Loading…
@rkooo567
24
[Frontend] OpenAI API server: Do not add bos token by default when encoding
#4688 opened May 8, 2024 by bofenghuang Loading…
7
ProTip! Updated in the last three days: updated:>2024-05-09.