Commits · b853540388bf8c796e1c88dabceaeebaab73621e · OpenDAS / vllm_cscc · GitLab

25 Oct, 2025 4 commits
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
- Revert "[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selectio… (#27502) · 56ed7609
  Zhuohan Li authored Oct 24, 2025
  
  56ed7609
- [CI] Add tests for cudagraph (#27391) · 29c9cb80
  Jiangyun Zhu authored Oct 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  29c9cb80
- [KVConnector] Migrate the LMCache integration code to be vLLM native (#25542) · 83f478bb
  Yihua Cheng authored Oct 24, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  83f478bb
24 Oct, 2025 30 commits
- [Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0
  Varun Sundar Rabindranath authored Oct 24, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  269c4db0
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
- [Distributed] Basic set of configuration for large EP deployment on GB200 (#27328) · d95d0f4b
  Pengchao Wang authored Oct 24, 2025
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  d95d0f4b
- [Perf][Async Scheduling] Remove CPU->GPU sync in dummy_run (#27455) · 04024282
  Lehua Ding authored Oct 25, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
```
  04024282
- [Document] Add ms-swift library to rlhf.md (#27469) · 17af6aa0
  jinghanhu authored Oct 25, 2025
  
  17af6aa0
- [CI/Build] Fix test_torch_utils in AMD CI (#27317) · fc168c33
  Zhewen Li authored Oct 24, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  fc168c33
- [Bugfix] Fix interns1-vit qk norm code path (#27480) · acc78aeb
  Isotr0py authored Oct 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc78aeb
- [Attention] Add MLA prefill backend: trtllm_ragged_attention_deepseek (#26397) · 0f67d4d9
  Ming Yang authored Oct 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  0f67d4d9
- [Bugfix] Fix MultiConnector stats reconstruction across process boundaries (#27366) · 7e1d697b
  kourosh hakhamaneshi authored Oct 24, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7e1d697b
- [NIXL][BUGFIX] delay done_recving queue cleanup to bottom of get_finished (#27297) · 699d62e6
  Chendi.Xue authored Oct 24, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  699d62e6
- [compile] Turn standalone_compile back on (#27460) · cd390b60
  Richard Zou authored Oct 24, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  cd390b60
- [cpu][fix] Fix onednn_mm crash on consecutive matmuls with same M,K,N and different dtype (#27472) · 2080b050
  Fadi Arafeh authored Oct 24, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2080b050
- [Doc] Fix minor issues in docs/design/metrics.md (#27436) · 6454afec
  Lifans authored Oct 24, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  6454afec
- Fix test named tool use (#27458) · 41a62564
  Chauncey authored Oct 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  41a62564
- [MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  284cc922
- Fix AArch64 CPU Docker pipeline (#27331) · 435be10d
  ioana ghiban authored Oct 24, 2025
```
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
```
  435be10d
- [Benchmark] Enable benchmark to run with `encoding_format="bytes"` (#27467) · b7030d96
  Cyrus Leung authored Oct 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7030d96
- [Refactor] move tool parsing logic from protocol.py to the tool parser (#27383) · 35678169
  Chauncey authored Oct 24, 2025
```
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  35678169
- [BugFix] Fix torchrun DP with LLM class (#27395) · e0ef8a29
  22quinn authored Oct 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  e0ef8a29
- [MM][Bugfix] Replace `PatchEmbed`'s conv3d to linear layer (#27418) · 42efe609
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  42efe609
- [Docs] remove v1 column for embedding models (#27446) · 88d3141e
  Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  88d3141e
- [Misc] Avoid "PyTorch non-writable tensors" warning in RayPPCommunicator (#27443) · 09a6a49e
  Rui Qiao authored Oct 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  09a6a49e
- [Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) · 07447554
  strinczer authored Oct 24, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  07447554
- [Chore] remove structural tags logging lines (#27451) · d4c574c3
  Aaron Pham authored Oct 24, 2025
  
  d4c574c3
- Fix EventPublisherFactory logic for disabled KV cache events (#27419) · c528b900
  usberkeley authored Oct 24, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  c528b900
- [Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  85fee74b
- [Misc] Add TPU usage report when using tpu_inference. (#27423) · 8dbe0c52
  hfan authored Oct 23, 2025
```
Signed-off-by: Hongmin Fan <fanhongmin@google.com>
```
  8dbe0c52
- [Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by... · 5cc6bddb
  Xiangyu Li authored Oct 24, 2025
```
[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)
```
  5cc6bddb
- Fix pooling adapters for Transformers backend (#27338) · 1f9460c4
  Harry Mellor authored Oct 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1f9460c4
- Granite 4.0 quark quantization support (#26944) · 70022ffc
  xiao-llm authored Oct 23, 2025
```
Signed-off-by: Xiao YU <Xiao.YU@xilinx.com>
Signed-off-by: Xiao Yu <xiao.yu.dc@outlook.com>
Co-authored-by: Xiao YU <Xiao.YU@xilinx.com>
```
  70022ffc
23 Oct, 2025 6 commits
- [Hardware][POWERPC] Disable oneDNN path in vllm/model_executor/layers/utils.py for Powerpc (#27422) · f417746a
  Akash kaothalkar authored Oct 24, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f417746a
- [Model] Siglip Embedding Support (#27324) · 0552cfb1
  Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  0552cfb1
- [Bugfix][DP] Fix creating too many DP Placement Groups (#26880) · 51dd14ac
  Kebe authored Oct 24, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  51dd14ac
- [Attention] Fix FlashMLA metadata builder arguments for q_len > 1 (#27368) · dbfbf9f3
  Matthew Bonanni authored Oct 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  dbfbf9f3
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [Misc] Add triton_kernels dependency (#27370) · a9f55dc5
  Varun Sundar Rabindranath authored Oct 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  a9f55dc5