Commits · 0118cdcc02ae16a137645e2289bf41f5e3da9d80 · OpenDAS / vllm_cscc

22 Jan, 2026 4 commits
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
21 Jan, 2026 1 commit
- [Bugfix] Force using spawn multiprocess method when it's the WSL platform (#32749) · 6bb2bc71
  Yanwen Lin authored Jan 21, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
```
  6bb2bc71
20 Jan, 2026 1 commit
- [Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652) · c4e5bdf6
  Chauncey authored Jan 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c4e5bdf6
19 Jan, 2026 1 commit
- [CI] Add Helion as an optional dependency (#32482) · 9d1e611f
  Yanan Cao authored Jan 19, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  9d1e611f
18 Jan, 2026 1 commit
- [Performance] Improve Triton prefill attention kernel's performance (#32403) · 8cc26acd
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8cc26acd
14 Jan, 2026 2 commits
- [Misc] Make mem utils can be reused by other platforms (#32322) · ce094624
  Shanshan Shen authored Jan 14, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  ce094624
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

10 Jan, 2026 3 commits
- [MISC] Add strict contiguity check for FlashInfer attention tensors (#32008) · e15a5ff0
  Vadim Gimpelson authored Jan 11, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
```
  e15a5ff0
- Revert "[Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#308… (#31617) · 1c46dea0
  shyeh25 authored Jan 11, 2026
```
Signed-off-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
```
  1c46dea0
- Update modelopt KV cache quantization resolution to new scheme (#31895) · 0c961487
  roikoren755 authored Jan 10, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  0c961487
07 Jan, 2026 5 commits

[refactor] refactor memory constants usage (#31865) · c907d221
Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
c907d221

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213) · cc6dafae

Kate Cheng authored Jan 07, 2026


Signed-off-by: Kate Cheng <yunhsuanc@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

cc6dafae

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106) · 4614c5a5

Kevin McKay authored Jan 07, 2026


Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Signed-off-by: Kevin McKay <kevin@example.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

4614c5a5

refactor: find_loaded_library (#31866) · 55caa605

tjp_zju authored Jan 07, 2026


Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

55caa605

[Chore] Try remove `init_cached_hf_modules` (#31786) · aafd4d23
Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aafd4d23

06 Jan, 2026 3 commits

[Log] add log about gpu worker init snapshot and requested memory (#29493) · 6f5e6533
Ning Xie authored Jan 07, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
6f5e6533
[Chore] Cleanup `mem_utils.py` (#31793) · 14df02b4
Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
14df02b4

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

05 Jan, 2026 1 commit
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

24 Dec, 2025 1 commit
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
22 Dec, 2025 1 commit
- [Misc] Fix quantization-related typos (#31116) · ec58c10c
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  ec58c10c
19 Dec, 2025 1 commit
- [Refactor] Refactor for `DeepGemmQuantScaleFMT` using cache (#30898) · 3bd8335b
  Wentao Ye authored Dec 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3bd8335b
17 Dec, 2025 3 commits
- [Chore] Factor out logic for requesting initial memory (#30868) · 2497228a
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2497228a
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785) · 7b966ae2
  danielafrimi authored Dec 17, 2025
```
Signed-off-by: <>
Co-authored-by: root <root@gpu-937.slurm-workers-slurm.slurm.svc.cluster.local>
```
  7b966ae2
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
16 Dec, 2025 1 commit
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
15 Dec, 2025 1 commit
- Revert "[Fix]Load kv-cache dtype from hf_quant_config.json automatically" (#30653) · e2ed2388
  Robert Shaw authored Dec 14, 2025
  
  e2ed2388
14 Dec, 2025 1 commit
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (#29980) · 6ec0d8db
  danielafrimi authored Dec 12, 2025
```
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
```
  6ec0d8db
10 Dec, 2025 1 commit
- [bug] Fix "Current vLLM config is not set." warnings when FlashInfer attention is used (#30241) · eea41804
  Po-Han Huang (NVIDIA) authored Dec 11, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  eea41804
09 Dec, 2025 1 commit

[Bugfix] Fix DeepGEMM after #29546 (#30267) · ae339b1a

Zhewen Li authored Dec 08, 2025


Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Zhewen Li <zhewenli@meta.com>

ae339b1a

08 Dec, 2025 1 commit

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Frontend] Remove confusing -O.xx flag error (#30169) · cbedb703
Yanan Cao authored Dec 06, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
cbedb703