Commits · 38d8096760cd8f42fb65fc0ba2b9fb11f98d8ac3 · OpenDAS / vllm_cscc

12 Sep, 2025 1 commit

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

11 Sep, 2025 12 commits

[Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d

Michael Goin authored Sep 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c3aea10d

[Kernel][B200] `mxfp4` fused cutlass moe (#23696) · 074854b2

Duncan Moss authored Sep 11, 2025


Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

074854b2

fix some typos (#24616) · e26fef83
co63oc authored Sep 12, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
e26fef83
Fix model name included in responses (#24663) · c1eda615
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
c1eda615
[VLM] Optimize GLM4.5-V-style video processing to only decode necessary frames (#24161) · bcbe2a4d
Isotr0py authored Sep 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
bcbe2a4d
[CI] Split mteb test from Language Models Test (#24634) · fd1ce98c
wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
fd1ce98c
Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f5271f1
[CI] Split pooling from entrypoints Test (#24632) · a8b0361c
wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
a8b0361c
Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
e93f4cc9
[torchao] Support quantization configs using module swap (#21982) · 2048c4e3
Jerry Zhang authored Sep 10, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
2048c4e3

[Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5

TaehyunKim authored Sep 11, 2025


Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9bd831f5

[Bug] [Spec Decode] Fix model_initialization test and mismatch in aux_hidden_layers (#24613) · 6c8deacd

Wenlong Wang authored Sep 10, 2025


Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6c8deacd

10 Sep, 2025 23 commits
- [Kernel] Flashinfer MLA (trtllm-gen) decode kernel integration (#21078) · dcb28a33
  Hanjie Qiu authored Sep 10, 2025
```
Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  dcb28a33
- [torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307
  Gregory Shtrasberg authored Sep 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  9a161307
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
- [CI] Fail subprocess tests with root-cause error (#23795) · 4db44264
  Nick Hill authored Sep 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4db44264
- [Core] Support configuration parsing plugin (#24277) · 9fb74c27
  Xingyu Liu authored Sep 10, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9fb74c27
- [Core] Split LoRA layers (#24574) · bb3eb80d
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bb3eb80d
- [CI] Fix tensorizer test assertion (#24545) · fcc0a313
  pwschuurman authored Sep 10, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  fcc0a313
- fix some typos (#24167) · 3144d902
  co63oc authored Sep 10, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  3144d902
- [CI] Add PPL test for generation models (#24485) · bd98842c
  wang.yuqi authored Sep 10, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd98842c
- [CI/Build] split true unit tests to Entrypoints Unit Tests (#24418) · 492196ed
  Ye (Charlotte) Qi authored Sep 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  492196ed
- [BugFix][easy] Fix flaky test test_gpt_oss_multi_turn_chat (#24549) · 0b9a612f
  lacora authored Sep 10, 2025
```
Signed-off-by: lacora2017 <yehu@meta.com>
Co-authored-by: lacora2017 <yehu@meta.com>
```
  0b9a612f
- Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f36355ab
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- Support for NemotronH Nano VLM (#23644) · 72d30108
  danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  72d30108
- [ROCm][Bugfix] Fix Aiter RMSNorm (#23412) · 7c195d43
  vllmellm authored Sep 10, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7c195d43
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
- [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
  Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  feaf202e
- [Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae
  pwschuurman authored Sep 09, 2025
```
Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4377b1ae
- [Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271) · 009d689b
  Chenheli Hua authored Sep 09, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  009d689b
- [gpt-oss] Cache permute indices for faster MXFP4 MoE layer loading (#24154) · 0efdb5c3
  Wei authored Sep 09, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  0efdb5c3
- [BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41
  Wenlong Wang authored Sep 09, 2025
```
[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  53b42f41
- [CI] Adjust threshold for flaky ngram spec decoding test (#24528) · 83dd28aa
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  83dd28aa
- [CI] Retry flaky fp8 cutlass mla tests (#24536) · 7e7db043
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7e7db043
09 Sep, 2025 4 commits
- [CI] execute all piecewise compilation tests together (#24502) · b8a93076
  Jiangyun Zhu authored Sep 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  b8a93076
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
- [Bugfix] Handle the edge case in detokenizer where processed tokens contain... · 922d3b40
  d.transposed authored Sep 09, 2025
```
[Bugfix] Handle the edge case in detokenizer where processed tokens contain both `stop` str and `eos` token (#23938)
Signed-off-by: dtransposed <damian.bogunowicz@gmail.com>
```
  922d3b40
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04