Skip to content

Pull requests: vllm-project/vllm

New pull request New
460 Open 5,283 Closed
460 Open 5,283 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix] Remove comments re: pytorch for outlines + compressed-tensors dependencies ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12260 opened Jan 21, 2025 by tdoublep Loading…
4
[V1][Bugfix] Fix data item ordering in mixed-modality inference ready ONLY add when PR is ready to merge/full CI is needed
#12259 opened Jan 21, 2025 by ywang96 Loading…
16
[core] separate builder init and builder prepare for each batch
#12253 opened Jan 21, 2025 by youkaichao Loading…
1
[Model] Enable Inference Support for the New Baichuan-M1 Model documentation Improvements or additions to documentation
#12251 opened Jan 21, 2025 by rainkert Loading…
2
[torch.compile] decouple compile sizes and cudagraph sizes
#12243 opened Jan 21, 2025 by youkaichao Loading…
1
[Frontend] Set server's maximum number of generated tokens using generation_config.json frontend
#12242 opened Jan 21, 2025 by mhendrey Loading…
2
[Kernel] fix moe_align_block_size error condition
#12239 opened Jan 21, 2025 by jinzhen-lin Loading…
10
[Docs] Update FP8 KV Cache documentation documentation Improvements or additions to documentation
#12238 opened Jan 21, 2025 by mgoin Loading…
2
[Misc] Set default backend to SDPA for get_vit_attn_backend ready ONLY add when PR is ready to merge/full CI is needed
#12235 opened Jan 21, 2025 by wangxiyuan Loading…
10
[Misc] Move find_loaded_library to platform_aware_utils.py
#12231 opened Jan 20, 2025 by houseroad Loading…
6
[VLM] Merged multi-modal processor for Pixtral
#12211 opened Jan 20, 2025 by Flechman • Draft
@DarkLight1337 @ywang96
2
[V1][Spec Decode] Ngram Spec Decode
#12193 opened Jan 19, 2025 by LiuXiaoxuanPKU • Draft
1 of 7 tasks
2
[Bugfix] fix race condition that leads to wrong order of token returned
#12192 opened Jan 19, 2025 by joennlae Loading…
2
[Misc] Add Gemma2 GGUF support
#12186 opened Jan 18, 2025 by Isotr0py • Draft
1
1
[Kernel] add triton fused moe kernel for gptq/awq
#12185 opened Jan 18, 2025 by jinzhen-lin Loading…
18
[Hardware][Gaudi][Bugfix] Fix HPU tensor parallelism, enable multiprocessing executor
#12167 opened Jan 17, 2025 by kzawora-intel Loading…
2
[Quantization/Parameter] WIP: Another Implementation of the Quantization Parameter Subclass Substitution
#12158 opened Jan 17, 2025 by cennn Loading…
3
[Core] Optimize topp/topk calculation in sampler
#12156 opened Jan 17, 2025 by afierka-intel Loading…
1
[WIP][Hardware][CPU] testing branch for mlperf ci/build documentation Improvements or additions to documentation needs-rebase
#12141 opened Jan 17, 2025 by bigPYJ1151 • Draft
2
[Hardware][Gaudi][Feature] Support Contiguous PA
#12139 opened Jan 17, 2025 by zhouyu5 • Draft
1
[WIP] Multimodal model support for V1 TPU
#12133 opened Jan 16, 2025 by mgoin • Draft
2
[Misc] Update to Transformers 4.48 ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12120 opened Jan 16, 2025 by tlrmchlsmth Loading…
18
[Feature] Support VPTQ quantization ci/build
#12117 opened Jan 16, 2025 by wejoncy • Draft
1
[BUILD] Add VLLM_BUILD_EXT to control custom op build ci/build
#12116 opened Jan 16, 2025 by MengqingCao Loading…
2
[Misc]add modules_to_not_convert attribute to gptq series
#12103 opened Jan 16, 2025 by 1096125073 Loading…
1
ProTip! Filter pull requests by the default branch with base:main.