Commits · 5d9308968649c81ee5903fc2a77377d738ed2f6d · OpenDAS / vllm_cscc

"docs/serving/distributed_serving.md" did not exist on "402d37836059463c7ec8b1e25d40c29138f1dd40"

24 Dec, 2025 29 commits
- [cli] complete vllm cli help message (#31226) · 5d930896
  Ning Xie authored Dec 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5d930896
- [Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179) · 66c98874
  Kevin McKay authored Dec 24, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  66c98874
- [CI] Reorganization pooling_mteb_test (#31265) · 1ff67df1
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  1ff67df1
- [PERF] Add interleaved memory allocation to NUMA module (#30800) · 7cd288a4
  skaraban3807 authored Dec 24, 2025
  
  7cd288a4
- [Chore] Bump `lm-eval` version (#31264) · d2018073
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2018073
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf
- [Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131) · bd89ce16
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd89ce16
- [Bugfix][ROCm] Fix load issue on deepseek quark quantization when shared expert enabled (#31261) · b41aeb34
  Pleaplusone authored Dec 24, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  b41aeb34
- [CI/Build] Ignore data_parallel_size_local (#30281) · ddfac703
  Ryan Rock authored Dec 24, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ddfac703
- [ROCm][CI] Set TORCH_NCCL_BLOCKING_WAIT Distributed Tests On ROCm (#31259) · 6559d967
  Micah Williamson authored Dec 24, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  6559d967
- [ROCm][CI] Fix "Distributed Tests (H200)" Test (#31227) · 1c74150b
  kliuae authored Dec 24, 2025
```
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  1c74150b
- [ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979) · 0247a91e
  Andreas Karatzas authored Dec 24, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0247a91e
- Add `--max-model-len auto` to auto-fit context to available memory (#29431) · 8ee90c83
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8ee90c83
- [docker] Fix downloading sccache on aarch64 platform (#30070) · d7e05ac7
  Nick Cao authored Dec 23, 2025
```
Signed-off-by: Nick Cao <nickcao@nichi.co>
```
  d7e05ac7
- [XPU] Remove distributed_executor_backend check (#30760) · 471ddb99
  sihao_li authored Dec 24, 2025
```
Signed-off-by: sihao.li <sihao.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  471ddb99
- [Qwen3-Omni] fixed _get_feat_extract_output_lengths function (#31007) · bb24592d
  Xiong Wang authored Dec 24, 2025
```
Signed-off-by: Xiong Wang <wangxiongts@163.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  bb24592d
- [DeepSeek v3.2] Remove unnecessary syncwarps (#31047) · 369f47aa
  Matthew Bonanni authored Dec 24, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  369f47aa
- [Bugfix][ROCm][Dynamo][DS 3.1][FP8] fix unsupported hasattr call when Dynamo... · dabff12e
  zejunchen-zejun authored Dec 24, 2025
```
[Bugfix][ROCm][Dynamo][DS 3.1][FP8] fix unsupported hasattr call when Dynamo tracing for ROCm device (#31149)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
```
  dabff12e
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
- [ROCm][CI] Set VLLM_FLOAT32_MATMUL_PRECISION="tf32" For terratorch Tests In AMD CI (#31242) · 3ce791ac
  Micah Williamson authored Dec 23, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  3ce791ac
- [ROCm][CI][Bugfix] Fix Siglip2 rotary embedding dispatch and InternVL video test tolerance (#31235) · e42894f5
  Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e42894f5
- [Bug] Fix `Number of dimensions of tensors must match.` for Deepseek V3.2 (#31160) · 76e6a951
  Wentao Ye authored Dec 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  76e6a951
- [P/D] Mooncake connector support more protocols (#30133) · 8b59753c
  Chao Lei authored Dec 24, 2025
```
Signed-off-by: LCAIZJ <leichao139636@163.com>
```
  8b59753c
- [KVEvent] User request.block_hash for parent block_hash (#30544) · 538e830c
  Chen Zhang authored Dec 23, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  538e830c
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105
- [Bugfix] Enable `dynamic_dims` for different embeds shape (#31223) · dd424571
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd424571
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
- [CI] Add Qwen3-Next-FP8 to Blackwell model tests (#31049) · bc0a5a0c
  Vadim Gimpelson authored Dec 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  bc0a5a0c
23 Dec, 2025 11 commits

[ROCm][Bugfix] Fix RuntimeError in MMEncoderAttention by replacing .view() with .reshape() (#31203) · bfa2c0bb
Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
bfa2c0bb

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

[Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
Asaf Joseph Gardin authored Dec 23, 2025

34916ae3
docs: Add llm-d integration to the website (#31234) · 0736f901
Yuan Tang authored Dec 23, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
0736f901
Use helper function instead of looping through attribute names (#29788) · c016c95b
Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
c016c95b
Only patch `original_max_position_embeddings` for Transformers v4 (#31214) · 1339878e
Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
1339878e

[FIX] FP4 quantization kernel padding initialization bug (#31097) · b94f80ff

danielafrimi authored Dec 23, 2025



Signed-off-by: <>
Co-authored-by: root <root@gpu-193.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-951.slurm-workers-slurm.slurm.svc.cluster.local>

b94f80ff

Fix edge case Mistral tool parser (#30724) · 38c361f9

Joachim Studnia authored Dec 23, 2025

Signed-off-by: Joachim Studnia <joachim@mistral.ai>
Signed-off-by: Joachim Studnia <studniajoachim@gmail.com>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

38c361f9

[Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
bb62dda2
adapt voxtral (#31095) · 3faa8bee
Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
3faa8bee
Add util function for checking nesting of rope parameters (#31146) · b10d47e0
Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
b10d47e0