Commits · 6e865b6a83565c5d661091ec0886403edb171794 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "847a57cd1217c6fd51f8e1813af5fed31bae1a2f"

05 Dec, 2025 11 commits
- Refactor example prompts fixture (#29854) · 6e865b6a
  Chukwuma Nwaugha authored Dec 05, 2025
```
Signed-off-by: nwaughac@gmail.com
```
  6e865b6a
- [Bugfix] Correct num_q_heads on DCP for Flashinfer backends (#29487) · d698bb38
  Jingchun Gao authored Dec 05, 2025
```
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
```
  d698bb38
- [ROCm][CI] Increase the memory threshold for test_deep_sleep_fp8_kvcache (#30104) · 2c22c4ca
  Charlie Fu authored Dec 04, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  2c22c4ca
- Do not guard during noop elimination pass (#30095) · 5867819e
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  5867819e
- [ROCm][CI] Add jiwer dependency for testing (#30081) · 7c9b2c8f
  Charlie Fu authored Dec 04, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7c9b2c8f
- [PCP&DCP] move CUDAGraph check for PCP&DCP to the check func of platforms (#29952) · 0098a6e3
  Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0098a6e3
- [Model] Add Holo2 reasoning parser (#30048) · befb59e5
  Hubert de La Jonquiere authored Dec 05, 2025
```
Signed-off-by: hdlj-h <hubert@hcompany.ai>
```
  befb59e5
- [CI] fix silent error in nightly wheel index generation script, add generation... · aaddc9c8
  Shengqi Chen authored Dec 05, 2025
```
[CI] fix silent error in nightly wheel index generation script, add generation time to HTML index (#30060)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  aaddc9c8
- [CI/Build] Update batch invariant test trigger (#30080) · 263c38d7
  Zhewen Li authored Dec 04, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  263c38d7
- [CI/Build][AMD] Add Llama4 Maverick FP8 to AMD CI (#28695) · bcf43ab1
  Zhewen Li authored Dec 04, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  bcf43ab1
- [Perf] Enable separate shared_experts stream only for CUDA (#30085) · 4470ee2f
  Alexander Matveev authored Dec 04, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  4470ee2f
04 Dec, 2025 29 commits
- docs: update metrics design doc to use new vllm:kv_cache_usage_perc (#30041) · 690cc3ef
  TimWang authored Dec 05, 2025
```
Signed-off-by: Tim <tim.wang03@sap.com>
```
  690cc3ef
- [aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  1f0d1845
- [BugFix] Fix DBO assert `assert B_block_table == B_q` (#29933) · c8ab988b
  Lucas Wilkinson authored Dec 04, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c8ab988b
- [Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in... · 48a5fff6
  Peng-YM authored Dec 05, 2025
```
[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in streaming mode (#29074)
Signed-off-by: Peng-YM <1048217874pengym@gmail.com>
```
  48a5fff6
- Abstract eplb algo (#26471) · 1119f6e4
  Mercykid-bash authored Dec 05, 2025
```
Signed-off-by: Che Ruan <cr623@ic.ac.uk>
Signed-off-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Che Ruan <cr623@ic.ac.uk>
Co-authored-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1119f6e4
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
- [KVConnector] Remove v0-related kv connector components such as kv pipe and kv... · ece2825a
  Kuntai Du authored Dec 05, 2025
```
[KVConnector] Remove v0-related kv connector components such as kv pipe and kv lookup buffer (#29705)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  ece2825a
- [Bugfix] Fix FP8 MoE LoRA (#29890) · 652ba93d
  Jee Jee Li authored Dec 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  652ba93d
- support qwen3-vl handle requests with embeddings (#30037) · 6dcb07f6
  Tao Yun authored Dec 05, 2025
```
Signed-off-by: taoyun <1069423820@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6dcb07f6
- [CI][DCP][Perf] reduce DCP CI execution time (#29858) · 46cbbca0
  Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
```
  46cbbca0
- [Chore] Deprecate `merge_by_field_config` arg (#30035) · b286a311
  Cyrus Leung authored Dec 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b286a311
- [Doc] clarify nightly builds in developer docs (#30019) · 990f8064
  Shengqi Chen authored Dec 05, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  990f8064
- Mark DBO test as flaky on b200 for Distributed B200 test (#29913) · 5b4b42c0
  Doug Smith authored Dec 04, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  5b4b42c0
- [Model Runner V2] Implement get_num_sampled_and_rejected kernel (#30029) · cc050558
  Woosuk Kwon authored Dec 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc050558
- Use Transformers v5 RoPE standardisation and validation (#30046) · 5c32a06a
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5c32a06a
- Fix broken multiline assert in `LoRAModelManager.register_module` (#30032) · dd97e047
  Yongtao Huang authored Dec 04, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  dd97e047
- Delete HF version of Phi 4 MM (#30049) · 9998ea5b
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9998ea5b
- [Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c
  wang.yuqi authored Dec 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  74c4d80c
- [release] install regex (#30008) · 1b7c7f51
  Kevin H. Luu authored Dec 04, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1b7c7f51
- [Bugfix] Fix the issue with interleaved thinking when using streaming (#30033) · 6796ce8b
  Chauncey authored Dec 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6796ce8b
- [ROCm][CI][Bugfix] Fixing the `Multi-Modal Models Test (Extended) 1` group (#30013) · e96a6a6d
  Andreas Karatzas authored Dec 04, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e96a6a6d
- Validating Runai Model Streamer Integration with S3 Object Storage (#29320) · 6366c098
  Noa Neria authored Dec 04, 2025
```
Signed-off-by: Noa Neria <noa@run.ai>
```
  6366c098
- [P/D] Introduce Mooncake Transfer Engine as kv_connector (#24718) · 842aba50
  dtc authored Dec 04, 2025
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Signed-off-by: dtc <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  842aba50
- [CI/Build][AMD] Skip test on test_hybrid_attention_mamba_tensor_shapes on... · f2f4cea6
  rasmith authored Dec 04, 2025
```
[CI/Build][AMD] Skip test on test_hybrid_attention_mamba_tensor_shapes on ROCm, requires FLASHINFER (#29995)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  f2f4cea6
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
- Add DeepSeek-V3.2 tool parser. (#29848) · ffdd1811
  Xu Wenqing authored Dec 04, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  ffdd1811
- [ROCm] add fallback for aiter fp8 decode mla (#30005) · b8a6ae41
  Ye (Charlotte) Qi authored Dec 04, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  b8a6ae41
- [Core] Fix standalone runs of test_reset_prefix_cache_e2e (#29899) · 899e2ef5
  Mark McLoughlin authored Dec 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  899e2ef5
- [Misc] Move functions into `PoolingMetadata` (#30027) · 68eb5c8d
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68eb5c8d