Commits · 00bd08edeee5dd4d4c13277c0114a464011acf72 · OpenDAS / vllm_cscc

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

01 Mar, 2026 1 commit
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
28 Feb, 2026 2 commits
- [Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
  Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  7e08c22b
- [ROCm] Derive device capability from GCN arch string without CUDA init (#35069) · 94029ffa
  Andreas Karatzas authored Feb 27, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  94029ffa
27 Feb, 2026 1 commit
- [CI] Actually run tests/kernels/quantization/test_block_fp8.py in CI (#34274) · 4fec53cf
  Michael Goin authored Feb 26, 2026
  
  4fec53cf
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

25 Feb, 2026 2 commits

[XPU]Support CUDAGraph on XPU Platform (#34482) · 35d44b45

Xinyu Chen authored Feb 25, 2026


Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: chzhang <chaojun.zhang@intel.com>
Co-authored-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

35d44b45

[Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
8ad54a99

24 Feb, 2026 1 commit
- Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) · 9609b1f1
  danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  9609b1f1
23 Feb, 2026 2 commits
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
19 Feb, 2026 1 commit
- fix(docs): fix typos in comments and docstrings (#34836) · ad5aa6bd
  Manrique Vargas authored Feb 19, 2026
```
Signed-off-by: machov <mv1742@nyu.edu>
```
  ad5aa6bd
18 Feb, 2026 1 commit
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
17 Feb, 2026 2 commits

[Kernel] Triton-based Top-k and Top-p sampler kernels (#33538) · c656ba3b

Jongseok Park authored Feb 17, 2026


Signed-off-by: js_park <cakeng@naver.com>
Signed-off-by: Jongseok Park <37990712+cakeng@users.noreply.github.com>
Signed-off-by: Sunga Kim <sunga.kim@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Sunga Kim <sunga.kim@berkeley.edu>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

c656ba3b

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
574fe752

14 Feb, 2026 1 commit
- [Bugfix] Fix ROCm UVA CPU weight offloading broken by #32993 (#34543) · a0638d05
  Andreas Karatzas authored Feb 13, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a0638d05
13 Feb, 2026 1 commit

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066

Wei Zhao authored Feb 13, 2026


[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

59d53066

11 Feb, 2026 1 commit
- [Plugin] Simplify IO Processor Plugin interface (#34236) · c9a1923b
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9a1923b
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
06 Feb, 2026 3 commits
- [Log] Optimize duplicate startup log (#33944) · 67a746e8
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  67a746e8
- support view_from_cpu_tensor on XPU (#33868) · e969a169
  Xinyu Chen authored Feb 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  e969a169
- [Perf] Disable clean_logits in deepgemm fp8_mqa_logits kernel (#33568) · 79028d43
  Xin Yang authored Feb 05, 2026
  
  79028d43
05 Feb, 2026 2 commits
- [Bugfix] Suppress non-TTY color output on the process name part of the log (#29714) · 92e7562a
  Tsukasa OI authored Feb 06, 2026
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  92e7562a
- [perf] Integrate flashinfer concat_mla_k (#31171) · 59a5cb38
  jiahanc authored Feb 05, 2026
  
  59a5cb38
03 Feb, 2026 1 commit
- [Refactor] Clean up pooling serial utils (#33665) · 83449a5f
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83449a5f
01 Feb, 2026 1 commit

[Redo] #33110 with threading limit (#33502) · 21997f45

Cyrus Leung authored Feb 01, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: YunzhuLu <lucia.yunzhu@gmail.com>

21997f45

31 Jan, 2026 2 commits
- [Misc] Fix flashinfer related tests (#33462) · 63c08894
  Roy Wang authored Feb 01, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  63c08894
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
30 Jan, 2026 1 commit
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
29 Jan, 2026 2 commits

[NVIDIA] [feat] Integrate flashinfer Trtllmgen bf16 moe (#32954) · 0493d897
Linda authored Jan 29, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
```
0493d897

[Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65

Didier Durand authored Jan 29, 2026

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

31b25f65

28 Jan, 2026 2 commits
- [UX] Enable nested configs in config yaml files (#33193) · ca196918
  Michael Goin authored Jan 28, 2026
  
  ca196918
- [ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  4197168e
26 Jan, 2026 1 commit
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
24 Jan, 2026 2 commits

[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

22 Jan, 2026 3 commits
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622