Commits · 55cba4a05c203509b18e9c792f24d77bbe840f31 · OpenDAS / vllm_cscc · GitLab

26 Oct, 2025 9 commits
- [CI/Build] Update causal-conv1d installation (#27529) · 55cba4a0
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  55cba4a0
- Revert "[CI/Build] Use CPU for mm processing test on CI (#27522)" (#27531) · c7abff29
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c7abff29
- [Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6
  Yeshwanth N authored Oct 26, 2025
```
Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>
```
  71b1c8b6
- [Doc] Fix links to GH projects (#27530) · 8fb7b2fa
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8fb7b2fa
- [Doc] Remove Molmo warning (#27527) · be7b55a8
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  be7b55a8
- [bugfix]fix empty prompts for async-engine mode in benchmark throughput (#27494) · 315b860a
  Lucia Fang authored Oct 26, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  315b860a
- [Bugfix] Fix processor initialization for model from modelscope instead of HF (#27461) · 87c41c26
  rongfu.leng authored Oct 26, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  87c41c26
- [BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl... · 65d2cf95
  JartX authored Oct 26, 2025
```
[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl ROCm TORCH_SDPA (#27190)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  65d2cf95
- [CI/Build] Use CPU for mm processing test on CI (#27522) · d63cd9ff
  Isotr0py authored Oct 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d63cd9ff
25 Oct, 2025 7 commits
- [CI/Build] Refactor processing tests (#27470) · 66a168a1
  Cyrus Leung authored Oct 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  66a168a1
- [Attention] Add missing kv cache scale setup (#27490) · a99564ac
  Matthew Bonanni authored Oct 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a99564ac
- [Misc] Simplify max tokens in multimodal registry (#27500) · 4c5f6321
  Cyrus Leung authored Oct 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4c5f6321
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
- Revert "[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selectio… (#27502) · 56ed7609
  Zhuohan Li authored Oct 24, 2025
  
  56ed7609
- [CI] Add tests for cudagraph (#27391) · 29c9cb80
  Jiangyun Zhu authored Oct 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  29c9cb80
- [KVConnector] Migrate the LMCache integration code to be vLLM native (#25542) · 83f478bb
  Yihua Cheng authored Oct 24, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  83f478bb
24 Oct, 2025 24 commits
- [Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0
  Varun Sundar Rabindranath authored Oct 24, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  269c4db0
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
- [Distributed] Basic set of configuration for large EP deployment on GB200 (#27328) · d95d0f4b
  Pengchao Wang authored Oct 24, 2025
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  d95d0f4b
- [Perf][Async Scheduling] Remove CPU->GPU sync in dummy_run (#27455) · 04024282
  Lehua Ding authored Oct 25, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
```
  04024282
- [Document] Add ms-swift library to rlhf.md (#27469) · 17af6aa0
  jinghanhu authored Oct 25, 2025
  
  17af6aa0
- [CI/Build] Fix test_torch_utils in AMD CI (#27317) · fc168c33
  Zhewen Li authored Oct 24, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  fc168c33
- [Bugfix] Fix interns1-vit qk norm code path (#27480) · acc78aeb
  Isotr0py authored Oct 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc78aeb
- [Attention] Add MLA prefill backend: trtllm_ragged_attention_deepseek (#26397) · 0f67d4d9
  Ming Yang authored Oct 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  0f67d4d9
- [Bugfix] Fix MultiConnector stats reconstruction across process boundaries (#27366) · 7e1d697b
  kourosh hakhamaneshi authored Oct 24, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7e1d697b
- [NIXL][BUGFIX] delay done_recving queue cleanup to bottom of get_finished (#27297) · 699d62e6
  Chendi.Xue authored Oct 24, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  699d62e6
- [compile] Turn standalone_compile back on (#27460) · cd390b60
  Richard Zou authored Oct 24, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  cd390b60
- [cpu][fix] Fix onednn_mm crash on consecutive matmuls with same M,K,N and different dtype (#27472) · 2080b050
  Fadi Arafeh authored Oct 24, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2080b050
- [Doc] Fix minor issues in docs/design/metrics.md (#27436) · 6454afec
  Lifans authored Oct 24, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  6454afec
- Fix test named tool use (#27458) · 41a62564
  Chauncey authored Oct 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  41a62564
- [MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  284cc922
- Fix AArch64 CPU Docker pipeline (#27331) · 435be10d
  ioana ghiban authored Oct 24, 2025
```
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
```
  435be10d
- [Benchmark] Enable benchmark to run with `encoding_format="bytes"` (#27467) · b7030d96
  Cyrus Leung authored Oct 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7030d96
- [Refactor] move tool parsing logic from protocol.py to the tool parser (#27383) · 35678169
  Chauncey authored Oct 24, 2025
```
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  35678169
- [BugFix] Fix torchrun DP with LLM class (#27395) · e0ef8a29
  22quinn authored Oct 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  e0ef8a29
- [MM][Bugfix] Replace `PatchEmbed`'s conv3d to linear layer (#27418) · 42efe609
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  42efe609
- [Docs] remove v1 column for embedding models (#27446) · 88d3141e
  Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  88d3141e
- [Misc] Avoid "PyTorch non-writable tensors" warning in RayPPCommunicator (#27443) · 09a6a49e
  Rui Qiao authored Oct 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  09a6a49e
- [Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) · 07447554
  strinczer authored Oct 24, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  07447554
- [Chore] remove structural tags logging lines (#27451) · d4c574c3
  Aaron Pham authored Oct 24, 2025
  
  d4c574c3