Commits · fba785658170e8723ccba762654f30c54b0217a4 · OpenDAS / vllm_cscc · GitLab

10 Sep, 2025 40 commits
- [Perf] Warmup FlashInfer attention during startup (#23439) · fba78565
  Michael Goin authored Sep 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  fba78565
- [gpt-oss] raise error for flashinfer backend without trtllm (#24482) · b5e383cd
  Chen Zhang authored Sep 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  b5e383cd
- [torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307
  Gregory Shtrasberg authored Sep 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  9a161307
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
- [CI] Fail subprocess tests with root-cause error (#23795) · 4db44264
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4db44264
- [Bugfix] Enable FP8 KV cache for FlashInfer and Triton backend on non-sm100 GPUs (#24577) · a0933c3b
  Thien Tran authored Sep 11, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  a0933c3b
- [Misc] update log level debug to warning when process port is used by (#24226) · 09e68bce
  rongfu.leng authored Sep 11, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  09e68bce
- [Core] Support configuration parsing plugin (#24277) · 9fb74c27
  Xingyu Liu authored Sep 10, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9fb74c27
- [Bugfix] Fix DeepEP config for DP4TP4 (#23619) · 40329496
  Ming Yang authored Sep 10, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  40329496
- [Bugfix] fix modelopt exclude_modules name mapping (#24178) · 08abfa78
  tomeras91 authored Sep 10, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  08abfa78
- [Logging] allow config logging stream (#24336) · 2bef2d14
  Shiyan Deng authored Sep 10, 2025
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  2bef2d14
- [Doc] Add documentation for GLM-4.5 series models: tool-calling and reasoning parser (#24589) · 36cacd09
  Robin authored Sep 10, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  36cacd09
- [Core] Split LoRA layers (#24574) · bb3eb80d
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bb3eb80d
- [CI] Fix tensorizer test assertion (#24545) · fcc0a313
  pwschuurman authored Sep 10, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  fcc0a313
- [Platform] Custom ops support for LMhead and LogitsProcessor (#23564) · 736569da
  zzhxxx authored Sep 10, 2025
```
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
```
  736569da
- [BugFix] `python collect_env.py` and `vllm collect-env` compatibility with uv venv (#24066) · 2eb9986a
  Kay Yan authored Sep 10, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  2eb9986a
- [Docs] Fix warnings in `mkdocs build` (continued) (#24092) · ccee371e
  Hyogeun Oh (오효근) authored Sep 10, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  ccee371e
- Fix Auto_Round Quatization Loading on SM75 and Lower GPUs (#24217) · c0bd6a68
  RoadToNowhereX authored Sep 10, 2025
```
Signed-off-by: RoadToNowhereX <37441177+RoadToNowhereX@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c0bd6a68
- fix some typos (#24167) · 3144d902
  co63oc authored Sep 10, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  3144d902
- [CI/Build] bump timm dependency (#24189) · 2f5e5c18
  Daniele authored Sep 10, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  2f5e5c18
- [CI] Add PPL test for generation models (#24485) · bd98842c
  wang.yuqi authored Sep 10, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd98842c
- [rocm] enable torchao quantization for rocm (#24400) · d6069887
  Lifans authored Sep 10, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  d6069887
- [CI/Build] split true unit tests to Entrypoints Unit Tests (#24418) · 492196ed
  Ye (Charlotte) Qi authored Sep 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  492196ed
- [BugFix] Ensure integrity of reused CPU tensors during async scheduling (#24527) · f4f1a8df
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: guoze.lin <guozelin@tencent.com>
```
  f4f1a8df
- [BugFix][easy] Fix flaky test test_gpt_oss_multi_turn_chat (#24549) · 0b9a612f
  lacora authored Sep 10, 2025
```
Signed-off-by: lacora2017 <yehu@meta.com>
Co-authored-by: lacora2017 <yehu@meta.com>
```
  0b9a612f
- [BugFix][Multi Modal] Fix TensorSchema shape mismatch in Molmo (#24559) · 4c04eef7
  Wenlong Wang authored Sep 10, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  4c04eef7
- Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f36355ab
- [LoRA]: Add LoRA support to Mistral's Voxtral models (#24517) · 9e3c3a7d
  Yash Pratap Singh authored Sep 10, 2025
```
Signed-off-by: Yash Pratap Singh <yashsingh20001@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9e3c3a7d
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- Support for NemotronH Nano VLM (#23644) · 72d30108
  danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  72d30108
- [Docs] Document the extra memory footprint overhead when using EPLB (#24537) · 8b83b937
  Tyler Michael Smith authored Sep 10, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b83b937
- [Docs] Improve organisation of API Reference nav (#24569) · 9dbefd88
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9dbefd88
- [ROCm][Bugfix] Fix Aiter RMSNorm (#23412) · 7c195d43
  vllmellm authored Sep 10, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7c195d43
- [Attention] add DCP support for FLASH_ATTN_MLA backend (#24453) · 0ae43dbf
  Lucas Wilkinson authored Sep 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0ae43dbf
- [Model] Limit CPU threads for image transformations in InternVL to reduce cpu contention. (#24519) · 267c80d3
  li-jinpeng authored Sep 10, 2025
```
Signed-off-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  267c80d3
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
- [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
  Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  feaf202e
- [docs] promo pytorch conf and ray summit (#24562) · 91130ae3
  Simon Mo authored Sep 09, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  91130ae3
- [Docs] Enable relative links in examples to function when rendered in the docs (#24041) · e4082728
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e4082728
- [Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae
  pwschuurman authored Sep 09, 2025
```
Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4377b1ae