Commits · 4d5943bda63c306275afc1a10edee26da45cd4ef · OpenDAS / vllm_cscc

14 Nov, 2025 1 commit
- [quantization][config] enable override existing quant_config (#28510) · 4d5943bd
  Hank_ authored Nov 14, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  4d5943bd
13 Nov, 2025 11 commits

[KV Connector] Test async mode in scheduler tests (#28550) · 6e25b1cd
Mark McLoughlin authored Nov 13, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
6e25b1cd
[Bugfix] Eliminate tuple inputs to submodules in graph partitioning (#28533) · 262d263f
Yanan Cao authored Nov 13, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
262d263f

[Perf] Support stream interval for reducing host overhead (#27869) · 5d6ce2b9

elvischenv authored Nov 14, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

5d6ce2b9

[Bugfix] Fix validate model input for decoder models (#27099) · 119c4927

Yannick Schnider authored Nov 13, 2025


Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

119c4927

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770

Varun Sundar Rabindranath authored Nov 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

fe1cd770

[Misc] Turn off encoder torch compile by default (#28634) · d3387750
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
d3387750
[Bugfix] Prevent crash on empty grammar string (#28210) · 4504e802
tjandy98 authored Nov 13, 2025
```
Signed-off-by: tjandy98 <3953059+tjandy98@users.noreply.github.com>
```
4504e802

[Frontend][responsesAPI][1/n] convert responses API tool input to chat... · 1a0b157a

Andrew Xia authored Nov 12, 2025


[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format (#28231)
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

1a0b157a

[Frontend] split append tool output (#28333) · 7c38ed0f
Andrew Xia authored Nov 12, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
7c38ed0f
[n-gen] DO NOT repeatedly return finished child requests (#28591) · a1d3866d
Jialin Ouyang authored Nov 12, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
a1d3866d
[platform] Move get_cu_count to utils (#27005) · 2dacd573
wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
2dacd573

12 Nov, 2025 13 commits

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

4ca5cd57

[BugFix] Priority scheduling and spec tokens preemption (#28558) · 58ce8d12
Andy Lo authored Nov 12, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
58ce8d12

[CI] Skip "Multi-Modal Models Test (Extended) 3" test that's broken in current... · a39dd7bb

Harry Mellor authored Nov 12, 2025


[CI] Skip "Multi-Modal Models Test (Extended) 3" test that's broken in current Transformers (#28559)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a39dd7bb

Implement ARC KV cache eviction policy for CPU offloader (#27039) · bac90456

alberto authored Nov 12, 2025


Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
Signed-off-by: alberto <aperdomo@redhat.com>
Co-authored-by: Or Ozeri <or@ozery.com>

bac90456

Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a742134c
[V0 deprecation] Deprecate use_v1 parameter (#28112) · 10138c92
wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
10138c92
[ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
edb59a94

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

`VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf

Andreas Karatzas authored Nov 11, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>

9f0247cf

[CPU] Refactor CPU attention backend (#27954) · 7f829be7
Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7f829be7
[[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
e1710393
[Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
48c87936
Use FLASHINFER MLA backend when testing fp8_kv_scale_compile (#28491) · d2353954
Adrian Abeyta authored Nov 11, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
d2353954

11 Nov, 2025 13 commits
- [Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) · 4228be79
  Jialin Ouyang authored Nov 11, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4228be79
- [CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424) · e5534249
  Zhewen Li authored Nov 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e5534249
- [Quantization] fix attention quantization of gpt_oss model (#27334) · 5a1271d8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  5a1271d8
- [ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  05576df8
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
  Nicolò Lucchesi authored Nov 11, 2025
  
  a7ef3eb0
- [BugFix] Fix Failing Ruff Check (#28469) · 533b018f
  jvlunteren authored Nov 11, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  533b018f
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
- [Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430) · e605e8e3
  Robert Shaw authored Nov 11, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  e605e8e3
- [Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32
  Zuyi Zhao authored Nov 10, 2025
```
[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  bca74e32
- [Misc] FlattenLogprobs -> FlatLogprobs (#28335) · 8d706cca
  Zhuohan Li authored Nov 10, 2025
  
  8d706cca
- [CI/Test Fix] Fix CP tests on Blackwell (#28404) · 39029d51
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  39029d51
10 Nov, 2025 2 commits
- [Test] Remove old non-varlen FA2 test (#28420) · 0bf29fad
  Matthew Bonanni authored Nov 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0bf29fad
- [Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
  Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  a5a790ee