Commits · 78c44fd722fe3ce010b0ba9c5e7349fe4094b39d · OpenDAS / vllm_cscc

05 Dec, 2025 30 commits
- [NIXL] Small cleanup of unused variables (#29618) · 78c44fd7
  Nicolò Lucchesi authored Dec 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  78c44fd7
- [bugfix] Pass globals to aot_compiled function (#29428) · e7296b08
  Angela Yi authored Dec 05, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  e7296b08
- [responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e
  Andrew Xia authored Dec 05, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  da7bc54e
- [NIXL] Add compatibility checking to NIXL KV connector handshake (#29503) · 949a6a19
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  949a6a19
- Reduce validation to a warning (#28749) · 2c174420
  Alec S authored Dec 05, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2c174420
- [Compressed Tensors] Add XPU `wNa16` support (#29484) · 0d8a7d8a
  Yi Liu authored Dec 05, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  0d8a7d8a
- [CPU][Perf] Add fast vectorized exp impl from Arm Optimized Routines (#30068) · 9843e332
  Elham authored Dec 05, 2025
```
Signed-off-by: Ubuntu <ubuntu@ip-10-252-30-150.eu-west-1.compute.internal>
Signed-off-by: Elham Harirpoush <elham.harirpoush@arm.com>
Co-authored-by: Ubuntu <ubuntu@ip-10-252-30-150.eu-west-1.compute.internal>
```
  9843e332
- [CI] Have pre-commit comment on a PR if pre-commit was not used (#30077) · b7d85cf2
  Harry Mellor authored Dec 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b7d85cf2
- [Feature] Add Layer-wise NVTX Support (#29990) · c2894d38
  Max Hu authored Dec 05, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Signed-off-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
```
  c2894d38
- [ROCm][MXFP4] Infer w4a4 quant method in rocm aiter fused moe (#29775) · 3628bcaa
  Zhiwei authored Dec 05, 2025
```
Signed-off-by: ZhiweiYan-96 <zhiwei.yan@amd.com>
```
  3628bcaa
- [Bugfix] Fix parse_output_message crash on commentary with no recipient (#29972) · b73b158a
  strinczer authored Dec 05, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Signed-off-by: strinczer <strinczer@icloud.com>
```
  b73b158a
- [typing] fix type (#29964) · 7ae13c66
  Ning Xie authored Dec 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  7ae13c66
- [bench] Support common prefix len config (for decode-only bench) (#29934) · f16356fe
  Ming Yang authored Dec 05, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f16356fe
- [BugFix] Adding env variable to disable async grammar compilation (#29996) · 65ee9728
  Alec S authored Dec 05, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  65ee9728
- [Frontend] Remove deprecated -O.xx flag (#29991) · 62b33334
  Yanan Cao authored Dec 05, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  62b33334
- [CI/Build][AMD] Use float16 in test_reset_prefix_cache_e2e to avoid accuracy issues (#29997) · feecba09
  rasmith authored Dec 05, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  feecba09
- [Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0
  amitz-nv authored Dec 05, 2025
```
[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
  6038b1b0
- [DOC]: Add kthena to integrations (#29931) · 60a66ea2
  Tiger Xu / Zhonghu Xu authored Dec 05, 2025
```
Signed-off-by: Zhonghu Xu <xuzhonghu@huawei.com>
```
  60a66ea2
- [AMD][CI] Add ray[default] Dependency On ROCm To Pass... · 06579f9a
  Micah Williamson authored Dec 05, 2025
```
[AMD][CI] Add ray[default] Dependency On ROCm To Pass v1/metrics/test_engine_logger_apis.py (#30110)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  06579f9a
- Refactor example prompts fixture (#29854) · 6e865b6a
  Chukwuma Nwaugha authored Dec 05, 2025
```
Signed-off-by: nwaughac@gmail.com
```
  6e865b6a
- [Bugfix] Correct num_q_heads on DCP for Flashinfer backends (#29487) · d698bb38
  Jingchun Gao authored Dec 05, 2025
```
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
```
  d698bb38
- [ROCm][CI] Increase the memory threshold for test_deep_sleep_fp8_kvcache (#30104) · 2c22c4ca
  Charlie Fu authored Dec 04, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  2c22c4ca
- Do not guard during noop elimination pass (#30095) · 5867819e
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  5867819e
- [ROCm][CI] Add jiwer dependency for testing (#30081) · 7c9b2c8f
  Charlie Fu authored Dec 04, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7c9b2c8f
- [PCP&DCP] move CUDAGraph check for PCP&DCP to the check func of platforms (#29952) · 0098a6e3
  Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0098a6e3
- [Model] Add Holo2 reasoning parser (#30048) · befb59e5
  Hubert de La Jonquiere authored Dec 05, 2025
```
Signed-off-by: hdlj-h <hubert@hcompany.ai>
```
  befb59e5
- [CI] fix silent error in nightly wheel index generation script, add generation... · aaddc9c8
  Shengqi Chen authored Dec 05, 2025
```
[CI] fix silent error in nightly wheel index generation script, add generation time to HTML index (#30060)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  aaddc9c8
- [CI/Build] Update batch invariant test trigger (#30080) · 263c38d7
  Zhewen Li authored Dec 04, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  263c38d7
- [CI/Build][AMD] Add Llama4 Maverick FP8 to AMD CI (#28695) · bcf43ab1
  Zhewen Li authored Dec 04, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  bcf43ab1
- [Perf] Enable separate shared_experts stream only for CUDA (#30085) · 4470ee2f
  Alexander Matveev authored Dec 04, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  4470ee2f
04 Dec, 2025 10 commits

docs: update metrics design doc to use new vllm:kv_cache_usage_perc (#30041) · 690cc3ef
TimWang authored Dec 05, 2025
```
Signed-off-by: Tim <tim.wang03@sap.com>
```
690cc3ef
[aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
1f0d1845
[BugFix] Fix DBO assert `assert B_block_table == B_q` (#29933) · c8ab988b
Lucas Wilkinson authored Dec 04, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
c8ab988b

[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in... · 48a5fff6

Peng-YM authored Dec 05, 2025


[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in streaming mode (#29074)
Signed-off-by: Peng-YM <1048217874pengym@gmail.com>

48a5fff6

Abstract eplb algo (#26471) · 1119f6e4

Mercykid-bash authored Dec 05, 2025

Signed-off-by: Che Ruan <cr623@ic.ac.uk>
Signed-off-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Che Ruan <cr623@ic.ac.uk>
Co-authored-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1119f6e4

Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e10c84e0

[KVConnector] Remove v0-related kv connector components such as kv pipe and kv... · ece2825a

Kuntai Du authored Dec 05, 2025


[KVConnector] Remove v0-related kv connector components such as kv pipe and kv lookup buffer (#29705)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

ece2825a

[Bugfix] Fix FP8 MoE LoRA (#29890) · 652ba93d
Jee Jee Li authored Dec 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
652ba93d

support qwen3-vl handle requests with embeddings (#30037) · 6dcb07f6

Tao Yun authored Dec 05, 2025


Signed-off-by: taoyun <1069423820@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6dcb07f6

[CI][DCP][Perf] reduce DCP CI execution time (#29858) · 46cbbca0
Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
```
46cbbca0