Commits · 05576df85c5274ee3045d90b0779d4adeecc09b9 · myrfy001 / vllm_dsv4

"devtools/ci/gh-actions/conda-envs/docs.yml" did not exist on "3aa4bb8c5d1d6da0e4207283fa5ea7f7a70d4005"

11 Nov, 2025 10 commits

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8

xuebwang-amd authored Nov 12, 2025


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

05576df8

[Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
68c09efc
[NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
Nicolò Lucchesi authored Nov 11, 2025

a7ef3eb0
[BugFix] Fix Failing Ruff Check (#28469) · 533b018f
jvlunteren authored Nov 11, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
533b018f
[Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
bnellnm authored Nov 11, 2025

a1448b4b

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

[Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430) · e605e8e3

Robert Shaw authored Nov 11, 2025


Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

e605e8e3

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

[Misc] FlattenLogprobs -> FlatLogprobs (#28335) · 8d706cca
Zhuohan Li authored Nov 10, 2025

8d706cca

[CI/Test Fix] Fix CP tests on Blackwell (#28404) · 39029d51

Lucas Wilkinson authored Nov 10, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

39029d51

10 Nov, 2025 10 commits

[Test] Remove old non-varlen FA2 test (#28420) · 0bf29fad
Matthew Bonanni authored Nov 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
0bf29fad
[Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
a5a790ee

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248) · d17ecc6b

Ilya Markov authored Nov 11, 2025

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d17ecc6b

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905) · 6d54336a

Rémi Delacourt authored Nov 10, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

6d54336a

[Bugfix] Fix persistent_masked_m_silu_mul_quant tests (#28366) · b039bfda

Varun Sundar Rabindranath authored Nov 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

b039bfda

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

[Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
6f7de33b
Restore PlaMo2 unit test as `pfnet/plamo-2-1b` now supports `transformers >=4.56` (#28019) · a98cc35c
Shinichi Hemmi authored Nov 10, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
a98cc35c
[V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
e8697faf
[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322) · 6b2b9fd9
Varun Sundar Rabindranath authored Nov 09, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
6b2b9fd9

09 Nov, 2025 4 commits
- [CI/Build] Temporary fix to LM Eval Small Models (#28324) · a65a934e
  Zhewen Li authored Nov 09, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  a65a934e
- Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214) · 4a8d6bd1
  usberkeley authored Nov 10, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4a8d6bd1
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
- [CI] Fix flaky `test_eagle_correctness` test (#28364) · 19d91ece
  Nicolò Lucchesi authored Nov 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  19d91ece
08 Nov, 2025 8 commits

[Bugfix] Fix test fused quant layernorm tests (#27865) · 171133f9

ElizaWszola authored Nov 08, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

171133f9

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

[Bugfix] Spec decode + structured output + spec model max len edge case (#28298) · 47604137
Andy Lo authored Nov 08, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
47604137
`reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d9ab1ad9

[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (#28101) · 934a9c3b

Isotr0py authored Nov 08, 2025


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>