Commits · 2bef2d1405faa1d1bd80b5183336a068396ec02d · OpenDAS / vllm_cscc · GitLab

10 Sep, 2025 30 commits
- [Logging] allow config logging stream (#24336) · 2bef2d14
  Shiyan Deng authored Sep 10, 2025
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  2bef2d14
- [Core] Split LoRA layers (#24574) · bb3eb80d
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bb3eb80d
- [Platform] Custom ops support for LMhead and LogitsProcessor (#23564) · 736569da
  zzhxxx authored Sep 10, 2025
```
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
```
  736569da
- [BugFix] `python collect_env.py` and `vllm collect-env` compatibility with uv venv (#24066) · 2eb9986a
  Kay Yan authored Sep 10, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  2eb9986a
- [Docs] Fix warnings in `mkdocs build` (continued) (#24092) · ccee371e
  Hyogeun Oh (오효근) authored Sep 10, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  ccee371e
- Fix Auto_Round Quatization Loading on SM75 and Lower GPUs (#24217) · c0bd6a68
  RoadToNowhereX authored Sep 10, 2025
```
Signed-off-by: RoadToNowhereX <37441177+RoadToNowhereX@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c0bd6a68
- fix some typos (#24167) · 3144d902
  co63oc authored Sep 10, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  3144d902
- [rocm] enable torchao quantization for rocm (#24400) · d6069887
  Lifans authored Sep 10, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  d6069887
- [BugFix] Ensure integrity of reused CPU tensors during async scheduling (#24527) · f4f1a8df
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: guoze.lin <guozelin@tencent.com>
```
  f4f1a8df
- [BugFix][Multi Modal] Fix TensorSchema shape mismatch in Molmo (#24559) · 4c04eef7
  Wenlong Wang authored Sep 10, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  4c04eef7
- Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f36355ab
- [LoRA]: Add LoRA support to Mistral's Voxtral models (#24517) · 9e3c3a7d
  Yash Pratap Singh authored Sep 10, 2025
```
Signed-off-by: Yash Pratap Singh <yashsingh20001@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9e3c3a7d
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- Support for NemotronH Nano VLM (#23644) · 72d30108
  danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  72d30108
- [ROCm][Bugfix] Fix Aiter RMSNorm (#23412) · 7c195d43
  vllmellm authored Sep 10, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7c195d43
- [Attention] add DCP support for FLASH_ATTN_MLA backend (#24453) · 0ae43dbf
  Lucas Wilkinson authored Sep 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0ae43dbf
- [Model] Limit CPU threads for image transformations in InternVL to reduce cpu contention. (#24519) · 267c80d3
  li-jinpeng authored Sep 10, 2025
```
Signed-off-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  267c80d3
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
- [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
  Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  feaf202e
- [Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae
  pwschuurman authored Sep 09, 2025
```
Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4377b1ae
- [Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271) · 009d689b
  Chenheli Hua authored Sep 09, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  009d689b
- [gpt-oss] Cache permute indices for faster MXFP4 MoE layer loading (#24154) · 0efdb5c3
  Wei authored Sep 09, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  0efdb5c3
- [BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41
  Wenlong Wang authored Sep 09, 2025
```
[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  53b42f41
- [P/D] MultiConnector supports shutdown (#24425) · 309d7aa4
  Chauncey authored Sep 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  309d7aa4
- [KV Connector] More async support for `get_num_new_matched_tokens` (#23620) · b4a01aaf
  Yihua Cheng authored Sep 09, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  b4a01aaf
- [BugFix] Fix async core engine client finalizer (#24540) · f88e8401
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f88e8401
- [Hardware][Apple-CPU] Enable native bfloat16 on Apple Silicon (M2 and later) (#24129) · 3c2156b3
  Ignacio Sica authored Sep 10, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
  3c2156b3
- [Perf] Convert np array to torch tensor to index into block table for attn chunking (#24474) · dc625ea6
  Yong Hoon Shin authored Sep 09, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dc625ea6
- [Bugfix] Fix for 24530. Fix naive all2all shared expert overlap. (#24538) · b23fb786
  bnellnm authored Sep 09, 2025
  
  b23fb786
- [Bugfix] Improve EPLB config validation error message (#24524) · 561f38dc
  Tyler Michael Smith authored Sep 09, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  561f38dc
09 Sep, 2025 10 commits
- [ROCm][Feature] Enable Pipeline Parallelism with Ray Compiled Graph on ROCm (#24275) · 73e688cb
  Charlie Fu authored Sep 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  73e688cb
- [Benchmark] Add option to skip oversampling in benchmark (#24457) · fb1a8f93
  Ekagra Ranjan authored Sep 09, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  fb1a8f93
- [Log] Use a relative path in debug-level logs to distinguish files with identical names (#23846) · b5fb3005
  Jiangyun Zhu authored Sep 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  b5fb3005
- [Feature] Disallow FlashMLA on Blackwell (#24521) · 15de5ff9
  Wentao Ye authored Sep 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  15de5ff9
- [TPU] Fix tpu structured decoding in mixed batches (#24458) · c3f9773b
  Chenyaaang authored Sep 09, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  c3f9773b
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
- [Bugfix] Fix hidden_size for multimodal classification model (#24501) · 9ad0688e
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9ad0688e
- [Kernels] Add Flash Linear Attention Kernels (#24518) · 1aa427fd
  youkaichao authored Sep 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1aa427fd
- [Core] Run garbage collector after CUDA graph capture to fix throughput regression (#24128) · 1c63a16b
  Micah Williamson authored Sep 09, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1c63a16b
- [Bugfix] Handle the edge case in detokenizer where processed tokens contain... · 922d3b40
  d.transposed authored Sep 09, 2025
```
[Bugfix] Handle the edge case in detokenizer where processed tokens contain both `stop` str and `eos` token (#23938)
Signed-off-by: dtransposed <damian.bogunowicz@gmail.com>
```
  922d3b40