Commits · 8c084de59d45a511aebe4005f49d9a81abceff3e · OpenDAS / vllm_cscc

19 Dec, 2025 1 commit
- [Refactor] Refactor for `DeepGemmQuantScaleFMT` using cache (#30898) · 3bd8335b
  Wentao Ye authored Dec 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3bd8335b
17 Dec, 2025 3 commits
- [Chore] Factor out logic for requesting initial memory (#30868) · 2497228a
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2497228a
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785) · 7b966ae2
  danielafrimi authored Dec 17, 2025
```
Signed-off-by: <>
Co-authored-by: root <root@gpu-937.slurm-workers-slurm.slurm.svc.cluster.local>
```
  7b966ae2
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
16 Dec, 2025 1 commit
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
15 Dec, 2025 1 commit
- Revert "[Fix]Load kv-cache dtype from hf_quant_config.json automatically" (#30653) · e2ed2388
  Robert Shaw authored Dec 14, 2025
  
  e2ed2388
14 Dec, 2025 1 commit
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (#29980) · 6ec0d8db
  danielafrimi authored Dec 12, 2025
```
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
```
  6ec0d8db
10 Dec, 2025 1 commit
- [bug] Fix "Current vLLM config is not set." warnings when FlashInfer attention is used (#30241) · eea41804
  Po-Han Huang (NVIDIA) authored Dec 11, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  eea41804
09 Dec, 2025 1 commit

[Bugfix] Fix DeepGEMM after #29546 (#30267) · ae339b1a

Zhewen Li authored Dec 08, 2025


Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Zhewen Li <zhewenli@meta.com>

ae339b1a

08 Dec, 2025 1 commit

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Frontend] Remove confusing -O.xx flag error (#30169) · cbedb703
Yanan Cao authored Dec 06, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
cbedb703

05 Dec, 2025 4 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[Feature] Add Layer-wise NVTX Support (#29990) · c2894d38

Max Hu authored Dec 05, 2025


Signed-off-by: Max Hu <hyoung2991@gmail.com>
Signed-off-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

c2894d38

[Frontend] Remove deprecated -O.xx flag (#29991) · 62b33334
Yanan Cao authored Dec 05, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
62b33334

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0

amitz-nv authored Dec 05, 2025


[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>

6038b1b0

04 Dec, 2025 1 commit
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
03 Dec, 2025 2 commits

[Bugfix] Respect VLLM_CONFIGURE_LOGGING value (#28671) · b5407869

Elizabeth Thomas authored Dec 03, 2025


Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Johnny Yang <johnnyyang@google.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Jane (Yuan) Xu <31798555+janeyx99@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Johnny Yang <24908445+jcyang43@users.noreply.github.com>

b5407869

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163) · 9bcf9229

Lumis Chen authored Dec 04, 2025


Signed-off-by: LuminolT <lumischen01@gmail.com>
Signed-off-by: Lumis Chen <lumischen01@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

9bcf9229

28 Nov, 2025 5 commits
- [Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  7675ba30
- [Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef
  Yanan Cao authored Nov 28, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  3461e7ef
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
- [mypy] Pass type checking for `vllm/utils` and `vllm/v1/pool` (#29666) · 953d9c82
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  953d9c82
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 2 commits

[UX] Suppress gloo log spam (#29250) · 8d6a89df
Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
8d6a89df

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79

George D. Torres authored Nov 25, 2025


Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

56531b79

25 Nov, 2025 2 commits
- Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a1f26768
- [Misc] Streamline unique id generation (#29375) · db290610
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  db290610
24 Nov, 2025 1 commit
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
21 Nov, 2025 1 commit
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
20 Nov, 2025 3 commits
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
- [Misc] Colorize logs (#29017) · 9ccef8e3
  Nick Hill authored Nov 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9ccef8e3
- [GC Debugger] Simply and improve GC Debugger Utils (#29029) · 537cc635
  Jialin Ouyang authored Nov 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  537cc635
19 Nov, 2025 4 commits

[Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac

Alexander Matveev authored Nov 19, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

3aaa94ac

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50

Shu Wang authored Nov 19, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

613abb50

[Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
9d2d5612

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc