Commits · 59b453eaa2b5434c62cf954e75937cd930cbdc13 · OpenDAS / vllm_cscc

06 Nov, 2025 1 commit
- [PERF] Decouple projections from GDN custom op. Attempt 2 (#28083) · b6a248bd
  Vadim Gimpelson authored Nov 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  b6a248bd
05 Nov, 2025 1 commit
- [Core] add support for reasoning parser plugins (#28075) · 752ddeac
  Walter Beller-Morales authored Nov 05, 2025
```
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
```
  752ddeac
04 Nov, 2025 4 commits
- Revert "[PERF] Decouple projections from GDN custom op" (#28080) · d4e547bb
  Vadim Gimpelson authored Nov 05, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  d4e547bb
- Remove deprecated `--rope-scaling` and `--rope-theta` (#28006) · 2f1cc8ce
  Harry Mellor authored Nov 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f1cc8ce
- [model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f
  yt0428 authored Nov 05, 2025
```
Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  05cae69f
- [PERF] Decouple projections from GDN custom op (#27512) · 5fd8f02e
  Vadim Gimpelson authored Nov 04, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  5fd8f02e
03 Nov, 2025 3 commits
- [Docs] add runai_streamer_sharded to LoadConfig (#27937) · 78603072
  Ning Xie authored Nov 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  78603072
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e
  ahao-anyscale authored Nov 03, 2025
```
[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cac4c10e
02 Nov, 2025 1 commit
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
01 Nov, 2025 2 commits

[Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
99d69af9

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

31 Oct, 2025 2 commits
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
30 Oct, 2025 7 commits
- [Feature] Batch invariant torch.compile (#27660) · e7acb200
  Paul Zhang authored Oct 30, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e7acb200
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
- [Bugfix] Improve GPU validation logging in Ray fallback scenarios (#25775) · 74374386
  Sairam Pillai authored Oct 30, 2025
```
Signed-off-by: Sairam Pillai <sairam.pillai61@gmail.com>
```
  74374386
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
- [V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784) · af826e08
  wangxiyuan authored Oct 30, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  af826e08
- [Bugfix] mamba-block-size is set for vision language model (#27773) · d7fb10c5
  Chen Zhang authored Oct 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  d7fb10c5
29 Oct, 2025 1 commit
- [CI/Build] Move pre-commit only scripts to `tools/pre_commit` (#27657) · 4fb8771c
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4fb8771c
28 Oct, 2025 6 commits
- [Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612
  Lucas Kabela authored Oct 28, 2025
```
[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>
```
  94666612
- [Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658) · f5710ef0
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5710ef0
- [Hybrid] Add mamba_block_size to Engine Args (#27289) · 05181cc5
  Asaf Joseph Gardin authored Oct 28, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  05181cc5
- [compile] Add enable_prompt_embeds to compile hash. (#27285) · 259504e1
  Zhengxu Chen authored Oct 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  259504e1
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95
- [Stability fix] turn off HMA allocator when connector is set (#27592) · 255e34ca
  Kuntai Du authored Oct 27, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  255e34ca
27 Oct, 2025 3 commits
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
- [Bugfix] Limit the default value of `max_model_len` when it is not specified by users (#27556) · a3e8611d
  Shanshan Shen authored Oct 27, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  a3e8611d
25 Oct, 2025 1 commit
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
24 Oct, 2025 2 commits

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

Fix pooling adapters for Transformers backend (#27338) · 1f9460c4
Harry Mellor authored Oct 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
1f9460c4

23 Oct, 2025 1 commit

[Feature] Pydantic validation for speculative.py (#27156) · faee3ccd

Navya Srivastava authored Oct 23, 2025


Signed-off-by: Navya Srivastava <navya.srivastava1707@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

faee3ccd

22 Oct, 2025 2 commits

[Feature] publisher default set zmq in kv_event config (#26915) · 8669c69a

rongfu.leng authored Oct 23, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8669c69a

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

21 Oct, 2025 2 commits
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
- [MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
  Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c3a2c6ac
20 Oct, 2025 1 commit

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143