Commits · bd98842c8a018d02d09f8c4249ea0547f505286d · OpenDAS / vllm_cscc

10 Sep, 2025 15 commits
- [CI] Add PPL test for generation models (#24485) · bd98842c
  wang.yuqi authored Sep 10, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd98842c
- [CI/Build] split true unit tests to Entrypoints Unit Tests (#24418) · 492196ed
  Ye (Charlotte) Qi authored Sep 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  492196ed
- [BugFix][easy] Fix flaky test test_gpt_oss_multi_turn_chat (#24549) · 0b9a612f
  lacora authored Sep 10, 2025
```
Signed-off-by: lacora2017 <yehu@meta.com>
Co-authored-by: lacora2017 <yehu@meta.com>
```
  0b9a612f
- Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f36355ab
- Feature/vit attention unification# 23880 (#23978) · 6cbd4190
  baonudesifeizhai authored Sep 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6cbd4190
- Support for NemotronH Nano VLM (#23644) · 72d30108
  danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  72d30108
- [ROCm][Bugfix] Fix Aiter RMSNorm (#23412) · 7c195d43
  vllmellm authored Sep 10, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7c195d43
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
- [Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
  Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  feaf202e
- [Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae
  pwschuurman authored Sep 09, 2025
```
Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  4377b1ae
- [Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271) · 009d689b
  Chenheli Hua authored Sep 09, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  009d689b
- [gpt-oss] Cache permute indices for faster MXFP4 MoE layer loading (#24154) · 0efdb5c3
  Wei authored Sep 09, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  0efdb5c3
- [BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41
  Wenlong Wang authored Sep 09, 2025
```
[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  53b42f41
- [CI] Adjust threshold for flaky ngram spec decoding test (#24528) · 83dd28aa
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  83dd28aa
- [CI] Retry flaky fp8 cutlass mla tests (#24536) · 7e7db043
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7e7db043
09 Sep, 2025 9 commits
- [CI] execute all piecewise compilation tests together (#24502) · b8a93076
  Jiangyun Zhu authored Sep 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  b8a93076
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
- [Bugfix] Handle the edge case in detokenizer where processed tokens contain... · 922d3b40
  d.transposed authored Sep 09, 2025
```
[Bugfix] Handle the edge case in detokenizer where processed tokens contain both `stop` str and `eos` token (#23938)
Signed-off-by: dtransposed <damian.bogunowicz@gmail.com>
```
  922d3b40
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04
- [Doc]: fixing typos to improve docs (#24480) · 46876dff
  Didier Durand authored Sep 09, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  46876dff
- [Misc] Support bench serve long context (#24373) · 1823a00d
  Ming Yang authored Sep 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  1823a00d
- [Bugfix] Fix Apertus HF repo name (#24447) · 948dd344
  Cyrus Leung authored Sep 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  948dd344
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
- [Flashinfer] Support Flashinfer TRTLLM FP8-qkv BF16/FP16-out Attention Kernel (#23647) · bba1042c
  elvischenv authored Sep 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  bba1042c
08 Sep, 2025 11 commits

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

[CI] Enable encoder model compilation test (#24442) · 7be141b2
Jiangyun Zhu authored Sep 09, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
7be141b2
[Model] Remove quantized mixtral (#24437) · 8d7f39b4
Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
8d7f39b4

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
03dd652c

[Misc] Terratorch related fixes (#24337) · 9cd76b71

Christian Pinto authored Sep 08, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9cd76b71

[Bugfix] Fix mamba2 prefill chunking (#23279) · e0413141

tomeras91 authored Sep 08, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0413141

[CI/Build] Fix local image inputs in test_pixtral.py (#24401) · 3bca396f
Chenheli Hua authored Sep 07, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
3bca396f
[CI/Build] Disable flaky test_structured_output tests (#24404) · 3a3e91bd
22quinn authored Sep 07, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
3a3e91bd

[Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8

Xingyu Liu authored Sep 07, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

b3d7e3c8

[Kernel] Support decode context parallelism on Blackwell with CUTLASS MLA (#24385) · 86173ad5

Ming Yang authored Sep 07, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

86173ad5

07 Sep, 2025 3 commits
- Add renderer-based prompt processing for embedding and classification endpoints (#24356) · 0661cb9d
  Flora Feng authored Sep 07, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0661cb9d
- [TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391) · 105d3d62
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  105d3d62
- [CI][Fix] deterministic seed for flaky CI runs on structured outputs (#24380) · e6759754
  Aaron Pham authored Sep 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  e6759754
06 Sep, 2025 2 commits
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
- [Bugfix] Fix unstable silu_mul+nvfp4 quant fusion test (#24370) · e68dc2f0
  elvischenv authored Sep 07, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  e68dc2f0