Commits · 66e674cdd549e89b341fb33405a2c02ec5f5ae8d · OpenDAS / vllm_cscc

05 Dec, 2025 2 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0

amitz-nv authored Dec 05, 2025


[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>

6038b1b0

04 Dec, 2025 1 commit
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
25 Nov, 2025 1 commit
- [Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
  Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  48ddb02b
19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
08 Nov, 2025 1 commit
- [Performance][gpt-oss] Revert gpt-oss max cudagraph size to 1024 (#28345) · 404d7a9d
  Mohammad Miadh Angkad authored Nov 09, 2025
```
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
```
  404d7a9d
05 Nov, 2025 2 commits
- [FlashInfer] Avoid FlashInfer block_size 16 + head_size 256 on blackwell (#27994) · c765f0b4
  Chen Zhang authored Nov 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  c765f0b4
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
02 Nov, 2025 1 commit
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
30 Oct, 2025 3 commits

[Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) · ab98f655

Tyler Michael Smith authored Oct 30, 2025


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

ab98f655

[Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b

Zhiyuan Li authored Oct 30, 2025


Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>

4e68cc9b

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

28 Oct, 2025 1 commit
- [Hybrid] Add mamba_block_size to Engine Args (#27289) · 05181cc5
  Asaf Joseph Gardin authored Oct 28, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  05181cc5
27 Oct, 2025 1 commit
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

18 Oct, 2025 2 commits

[BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690

Lucas Wilkinson authored Oct 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c2bba690

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f

13 Oct, 2025 1 commit
- [Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
  Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8e67b255
09 Oct, 2025 1 commit
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 2 commits

[V1] [Hybrid] Remove code to override default CUDA graph configuration (#26226) · ed3aeb25
Thomas Parnell authored Oct 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
ed3aeb25

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

01 Oct, 2025 1 commit
- [BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · 8d7da92f
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8d7da92f
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

24 Sep, 2025 1 commit
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
23 Sep, 2025 1 commit
- [Bugfix] Lower gpt-oss max cudagraph size to 992 to be compatible with FA3 (#25508) · a8ffc4f0
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a8ffc4f0
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

11 Sep, 2025 1 commit
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
06 Sep, 2025 1 commit
- [New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
  wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6d6c6b05
05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
02 Sep, 2025 1 commit

[Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c

wang.yuqi authored Sep 03, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0653f6c

28 Aug, 2025 1 commit
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa
27 Aug, 2025 2 commits
- [V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
  Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  853c371f
- [V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-based models (#23716) · 704432af
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  704432af
26 Aug, 2025 1 commit
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
15 Aug, 2025 1 commit

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

06 Aug, 2025 2 commits

[GptOss] Add GptOss reasoning parser to support structure output (#22322) · a47e6ffe

Chen Zhang authored Aug 05, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

a47e6ffe

Add GPT-OSS model code and config [1/N] (#22327) · de98252f
Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
de98252f

05 Aug, 2025 1 commit
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867