Commits · 59d53066d8daed5c2e39e3bce38ac308bc80a9ae · OpenDAS / vllm_cscc

13 Feb, 2026 1 commit

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066

Wei Zhao authored Feb 13, 2026


[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

59d53066

11 Feb, 2026 1 commit
- [Plugin] Simplify IO Processor Plugin interface (#34236) · c9a1923b
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9a1923b
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
06 Feb, 2026 3 commits
- [Log] Optimize duplicate startup log (#33944) · 67a746e8
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  67a746e8
- support view_from_cpu_tensor on XPU (#33868) · e969a169
  Xinyu Chen authored Feb 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  e969a169
- [Perf] Disable clean_logits in deepgemm fp8_mqa_logits kernel (#33568) · 79028d43
  Xin Yang authored Feb 05, 2026
  
  79028d43
05 Feb, 2026 2 commits
- [Bugfix] Suppress non-TTY color output on the process name part of the log (#29714) · 92e7562a
  Tsukasa OI authored Feb 06, 2026
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  92e7562a
- [perf] Integrate flashinfer concat_mla_k (#31171) · 59a5cb38
  jiahanc authored Feb 05, 2026
  
  59a5cb38
03 Feb, 2026 1 commit
- [Refactor] Clean up pooling serial utils (#33665) · 83449a5f
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83449a5f
01 Feb, 2026 1 commit

[Redo] #33110 with threading limit (#33502) · 21997f45

Cyrus Leung authored Feb 01, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: YunzhuLu <lucia.yunzhu@gmail.com>

21997f45

31 Jan, 2026 2 commits
- [Misc] Fix flashinfer related tests (#33462) · 63c08894
  Roy Wang authored Feb 01, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  63c08894
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
30 Jan, 2026 1 commit
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
29 Jan, 2026 2 commits

[NVIDIA] [feat] Integrate flashinfer Trtllmgen bf16 moe (#32954) · 0493d897
Linda authored Jan 29, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
```
0493d897

[Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65

Didier Durand authored Jan 29, 2026

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

31b25f65

28 Jan, 2026 2 commits
- [UX] Enable nested configs in config yaml files (#33193) · ca196918
  Michael Goin authored Jan 28, 2026
  
  ca196918
- [ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  4197168e
26 Jan, 2026 1 commit
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
24 Jan, 2026 2 commits

[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

22 Jan, 2026 4 commits
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
21 Jan, 2026 1 commit
- [Bugfix] Force using spawn multiprocess method when it's the WSL platform (#32749) · 6bb2bc71
  Yanwen Lin authored Jan 21, 2026
```
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
```
  6bb2bc71
20 Jan, 2026 1 commit
- [Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652) · c4e5bdf6
  Chauncey authored Jan 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c4e5bdf6
19 Jan, 2026 1 commit
- [CI] Add Helion as an optional dependency (#32482) · 9d1e611f
  Yanan Cao authored Jan 19, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  9d1e611f
18 Jan, 2026 1 commit
- [Performance] Improve Triton prefill attention kernel's performance (#32403) · 8cc26acd
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8cc26acd
14 Jan, 2026 2 commits
- [Misc] Make mem utils can be reused by other platforms (#32322) · ce094624
  Shanshan Shen authored Jan 14, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  ce094624
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

10 Jan, 2026 3 commits
- [MISC] Add strict contiguity check for FlashInfer attention tensors (#32008) · e15a5ff0
  Vadim Gimpelson authored Jan 11, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
```
  e15a5ff0
- Revert "[Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#308… (#31617) · 1c46dea0
  shyeh25 authored Jan 11, 2026
```
Signed-off-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
```
  1c46dea0
- Update modelopt KV cache quantization resolution to new scheme (#31895) · 0c961487
  roikoren755 authored Jan 10, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  0c961487
07 Jan, 2026 5 commits

[refactor] refactor memory constants usage (#31865) · c907d221
Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
c907d221

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213) · cc6dafae

Kate Cheng authored Jan 07, 2026


Signed-off-by: Kate Cheng <yunhsuanc@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

cc6dafae

[Bugfix][Hardware][AMD] Consolidate FP8 min/max values helper function (#31106) · 4614c5a5

Kevin McKay authored Jan 07, 2026


Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Signed-off-by: Kevin McKay <kevin@example.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

4614c5a5

refactor: find_loaded_library (#31866) · 55caa605

tjp_zju authored Jan 07, 2026


Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

55caa605

[Chore] Try remove `init_cached_hf_modules` (#31786) · aafd4d23
Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aafd4d23

06 Jan, 2026 1 commit
- [Log] add log about gpu worker init snapshot and requested memory (#29493) · 6f5e6533
  Ning Xie authored Jan 07, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6f5e6533