Commits · ab98f6556ff84508cdcdcd6a6b1e612a7a8819d0 · OpenDAS / vllm_cscc

30 Oct, 2025 3 commits

[Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) · ab98f655

Tyler Michael Smith authored Oct 30, 2025


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

ab98f655

[Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b

Zhiyuan Li authored Oct 30, 2025


Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>

4e68cc9b

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

28 Oct, 2025 1 commit
- [Hybrid] Add mamba_block_size to Engine Args (#27289) · 05181cc5
  Asaf Joseph Gardin authored Oct 28, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  05181cc5
27 Oct, 2025 1 commit
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

18 Oct, 2025 2 commits

[BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) · c2bba690

Lucas Wilkinson authored Oct 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c2bba690

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f

13 Oct, 2025 1 commit
- [Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
  Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8e67b255
09 Oct, 2025 1 commit
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 2 commits

[V1] [Hybrid] Remove code to override default CUDA graph configuration (#26226) · ed3aeb25
Thomas Parnell authored Oct 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
ed3aeb25

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

01 Oct, 2025 1 commit
- [BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · 8d7da92f
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8d7da92f
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

24 Sep, 2025 1 commit
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
23 Sep, 2025 1 commit
- [Bugfix] Lower gpt-oss max cudagraph size to 992 to be compatible with FA3 (#25508) · a8ffc4f0
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a8ffc4f0
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

11 Sep, 2025 1 commit
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
06 Sep, 2025 1 commit
- [New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
  wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6d6c6b05
05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
02 Sep, 2025 1 commit

[Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c

wang.yuqi authored Sep 03, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0653f6c

28 Aug, 2025 1 commit
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa
27 Aug, 2025 2 commits
- [V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
  Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  853c371f
- [V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-based models (#23716) · 704432af
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  704432af
26 Aug, 2025 1 commit
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
15 Aug, 2025 1 commit

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

06 Aug, 2025 2 commits

[GptOss] Add GptOss reasoning parser to support structure output (#22322) · a47e6ffe

Chen Zhang authored Aug 05, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

a47e6ffe

Add GPT-OSS model code and config [1/N] (#22327) · de98252f
Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
de98252f

05 Aug, 2025 1 commit
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
31 Jul, 2025 1 commit
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

16 Jul, 2025 1 commit

[Model] Add ModelConfig class for GraniteMoeHybrid to override default... · 6cbc4d4b

Thomas Parnell authored Jul 16, 2025


[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

6cbc4d4b

15 Jul, 2025 1 commit
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
10 Jul, 2025 1 commit
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
04 Jul, 2025 1 commit
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
27 Jun, 2025 1 commit
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6