Commits · 3e41992fecdc31ee60715bb350f18fec18ed6680 · OpenDAS / vllm_cscc

12 Dec, 2025 1 commit
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
11 Dec, 2025 1 commit
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
06 Dec, 2025 1 commit
- Support tokenization_kwargs override (#29794) · 43e75930
  Yu Jiaqi authored Dec 06, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  43e75930
05 Dec, 2025 2 commits

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

Refactor example prompts fixture (#29854) · 6e865b6a
Chukwuma Nwaugha authored Dec 05, 2025
```
Signed-off-by: nwaughac@gmail.com
```
6e865b6a

02 Dec, 2025 2 commits

[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413

ImaGoodFella authored Dec 02, 2025


[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

60c3d413

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761) · 3b221cb6
Boyuan Feng authored Dec 01, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
3b221cb6

29 Nov, 2025 2 commits
- hfrunner.classify should return list[list[float]] not list[str] (#29671) · ad7f714d
  Chukwuma Nwaugha authored Nov 29, 2025
```
Signed-off-by: Chukwuma Nwaugha <nwaughac@gmail.com>
```
  ad7f714d
- Add gpu memory wait before test_async_tp (#28893) · 4b17ce68
  Angela Yi authored Nov 28, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4b17ce68
22 Nov, 2025 2 commits
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
13 Nov, 2025 1 commit

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770

Varun Sundar Rabindranath authored Nov 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

fe1cd770

05 Nov, 2025 1 commit
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
01 Nov, 2025 1 commit
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
28 Oct, 2025 1 commit
- [AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4fe58953
19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
16 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
15 Oct, 2025 2 commits
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
06 Oct, 2025 2 commits
- [Tests] conftest: Extending VllmRunner and HfRunner to accept token_ids as input (#26295) · 6431be80
  Yannick Schnider authored Oct 06, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6431be80
- [CI] Add comment about the single cudagraph capture size that is used (#26252) · d3c84297
  Thomas Parnell authored Oct 06, 2025
  
  d3c84297
05 Oct, 2025 2 commits
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Always apply MM processor even when no MM items are passed (#26240) · b7e8e4e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7e8e4e6
03 Oct, 2025 1 commit
- [test utils] correct wrong typing (#26159) · 5446ad1d
  Yannick Schnider authored Oct 03, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  5446ad1d
02 Oct, 2025 1 commit
- Change size of single CUDA graph for CI to 4 (#26089) · be8921fb
  Thomas Parnell authored Oct 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  be8921fb
01 Oct, 2025 1 commit
- [CI] Only capture a single CUDA graph size in CI by default (#25951) · a332b845
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a332b845
24 Sep, 2025 1 commit
- [CI/Build] Fix v1 OOT registration test (#25547) · 27ec3c78
  Isotr0py authored Sep 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  27ec3c78
21 Sep, 2025 2 commits

[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) · 26e673fe

Woosuk Kwon authored Sep 21, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

26e673fe

[V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

52c2a8d4

20 Sep, 2025 2 commits
- [V0 Deprecation] Enable the remaining multimodal tests in V1 (#25307) · bef180f0
  Cyrus Leung authored Sep 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bef180f0
- [V1] Support `LLM.apply_model` (#18465) · 3d9a1d2d
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d9a1d2d
19 Sep, 2025 2 commits
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- [Misc] Cleanup test conftest for deprecated encoder-decoder models (#25231) · f2718d29
  Isotr0py authored Sep 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f2718d29
10 Sep, 2025 1 commit
- [CI] Fail subprocess tests with root-cause error (#23795) · 4db44264
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4db44264
03 Sep, 2025 1 commit

[CI/Build] Serve images used by multimodal tests through local HTTP Server (#23907) · 70549c12

dsinghvi authored Sep 03, 2025


Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70549c12

01 Sep, 2025 1 commit

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

28 Aug, 2025 1 commit
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa