Commits · f05fea1f5e91007bc7c53a9e3178ffa9becaa403 · OpenDAS / vllm_cscc

"deploy/cloud/vscode:/vscode.git/clone" did not exist on "c675fd1b040beb6172dca998307bb8d6ae089aaf"

04 Oct, 2025 8 commits
- [Core] Enable decode of context length equal to max model length (#26168) · f05fea1f
  Yannick Schnider authored Oct 04, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  f05fea1f
- Add Olmo 3 reasoning parser (#26054) · d0df145c
  Luca Soldaini authored Oct 04, 2025
```
Signed-off-by: Luca Soldaini <luca@soldaini.net>
```
  d0df145c
- Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
  Cyrus Leung authored Oct 04, 2025
  
  1838cd48
- [CI Failure] fix_test_auto_prefix_cache_support (#26053) · 7d6b0338
  Huamin Li authored Oct 04, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  7d6b0338
- [Model] Support nested structures for TensorSchema (#26212) · 44ea8513
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44ea8513
- [V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a
  Stan Wozniak authored Oct 04, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ea507c3a
- Add batch invariant kernel override for FlashInfer backend [2/n] (#25769) · 2f7dbc9b
  Bram Wasti authored Oct 03, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f7dbc9b
- [BugFix] Use async Mistral Tokenizer in Chat Completions (#26134) · ea25a76c
  Ben Browning authored Oct 03, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea25a76c
03 Oct, 2025 15 commits
- [BugFix] Fix de-functionalization pass for rotary_embedding (#23953) · 7cfa4b24
  Angela Yi authored Oct 03, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  7cfa4b24
- [responsesAPI] add better error messaging for long prompts (#25724) · 831b1241
  Andrew Xia authored Oct 03, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  831b1241
- [CI/Build] do not enforce precompilation on tpu ci tests (#25992) · adae0c1f
  Xiang Si authored Oct 03, 2025
```
Signed-off-by: Xiang Si <sixiang@google.com>
```
  adae0c1f
- [Bugfix] Re-enable prefill of max model length (#24446) · 8ee846c2
  Yannick Schnider authored Oct 03, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  8ee846c2
- [Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54
  Yang Liu authored Oct 03, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  812b7f54
- [Multi Modal] Configurable MM Profiling (#25631) · 79aa2446
  Wenlong Wang authored Oct 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  79aa2446
- [openai] Fix missing tool usage check (system message) (#24768) · 2ed3f20d
  kyt authored Oct 03, 2025
```
Signed-off-by: kyt <eluban4532@gmail.com>
```
  2ed3f20d
- [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388) · 48f30902
  Nicolò Lucchesi authored Oct 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  48f30902
- [CI] Fix distributed hybrid tests in CI (#26155) · 0e93ac0b
  Thomas Parnell authored Oct 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  0e93ac0b
- [test utils] correct wrong typing (#26159) · 5446ad1d
  Yannick Schnider authored Oct 03, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  5446ad1d
- add(v1): RequestStatesStats to RequestOutput (#24947) · 3e70e3d4
  HUIJONG JEONG authored Oct 03, 2025
```
Signed-off-by: huijjj <huijong.jeong@squeezebits.com>
```
  3e70e3d4
- [Input] Remove unused `prompt` field (#26097) · 0ad9951c
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ad9951c
- `FusedMoE` support for the Transformers backend (#22650) · 10d76548
  Harry Mellor authored Oct 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  10d76548
- [gpt-oss] disable tool server initialization if no tool in request (#25790) · e5017cd6
  Andrew Xia authored Oct 02, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e5017cd6
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
02 Oct, 2025 6 commits

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

[Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
1e50f1be

[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529

Cyrus Leung authored Oct 03, 2025


[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

d00d6529

[CI] Add Blackwell DeepSeek FP8 FlashInfer MoE tests (#26040) · 3b279a84
Michael Goin authored Oct 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
3b279a84
Change size of single CUDA graph for CI to 4 (#26089) · be8921fb
Thomas Parnell authored Oct 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
be8921fb
Run:ai model streamer add GCS package support (#24909) · be22bb6f
pwschuurman authored Oct 01, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
be22bb6f

01 Oct, 2025 6 commits
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
- [CI] Tweaks to GPT-OSS Eval (Blackwell) for stability (#26030) · ee04c0cd
  Michael Goin authored Oct 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ee04c0cd
- Fix test_mamba_ssm_ssd.py due to missing _query_start_loc_to_chunk_indices_offsets (#25995) · c36f0aa3
  Huamin Li authored Oct 01, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c36f0aa3
- [CI] Only capture a single CUDA graph size in CI by default (#25951) · a332b845
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a332b845
- Update to Transformers `v4.56.2` (#24638) · 2a69ab48
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2a69ab48
- [Model] MTP fallback to eager for DeepSeek v32 (#25982) · 001e50c9
  Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  001e50c9
30 Sep, 2025 5 commits

[gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b

Andrew Xia authored Sep 30, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

5db1870b

Add explicit pooling classes for the Transformers backend (#25322) · a388252a

Harry Mellor authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a388252a

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
9a9f48df
[Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2f652e6c

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76