Commits · 6183cae1bd8db73ee579f6424382975b17d02fb0 · OpenDAS / vllm_cscc

01 Apr, 2026 2 commits
- [Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730) · 6183cae1
  Stefano Castagnetta authored Apr 01, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  6183cae1
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
31 Mar, 2026 2 commits

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix] Fix for builtins (forward fix of pytorch/177558) (#37234) · e3191506
Lucas Kabela authored Mar 30, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
e3191506

29 Mar, 2026 1 commit
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
28 Mar, 2026 1 commit
- [ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413) · 58a249bc
  TJian authored Mar 28, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  58a249bc
24 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/model_executor` (except `vllm/model_executor/layers`) (#37904) · b3601da6
  Harry Mellor authored Mar 24, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3601da6
23 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/config` (#37808) · 45bd5c8e
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  45bd5c8e
17 Mar, 2026 2 commits
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
16 Mar, 2026 1 commit
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 4 commits

Update Flashinfer to 0.6.6 (#36768) · cc16b24b

Dimitrios Bariamis authored Mar 12, 2026


Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>

cc16b24b

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

[CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf

Martin Hickey authored Mar 12, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7f1f36bf

replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
894843eb

09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
07 Mar, 2026 1 commit
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 2 commits

[MISC] fixed tool_parser mypy errors (#35640) · 1aaec59d

Taneem Ibrahim authored Mar 04, 2026

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1aaec59d

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit
- [ROCm] [Release] Change the package from `aiter` to `amd-aiter` (#35198) · 5dfc5abe
  TJian authored Mar 03, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  5dfc5abe
02 Mar, 2026 1 commit

[CI] Fix mypy for vllm/device allocator (#35518) · 7560d674

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7560d674

01 Mar, 2026 2 commits

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

[MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
59d7af9c

27 Feb, 2026 2 commits

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896

26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

21 Feb, 2026 1 commit
- [Misc] Fix mypy errors in vllm/profiler and remove from exclude list (#34959) · d38cd3dd
  Taneem Ibrahim authored Feb 20, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  d38cd3dd
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [CI] Enable mypy import following for vllm/v1/kv_offload (#34639) · 0b5f9b72
  Aneesh Puttur authored Feb 16, 2026
```
Signed-off-by: Aneesh Puttur <aneeshputtur@gmail.com>
```
  0b5f9b72
16 Feb, 2026 1 commit

[CI] Enable mypy coverage for individual excluded files (#34292) · a3205bef

Lucas Kabela authored Feb 16, 2026


Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a3205bef

12 Feb, 2026 2 commits

[ROCm][CI] Pin TorchCodec to v0.10.0 for ROCm compatibility (#34447) · 4c078fa5
Andreas Karatzas authored Feb 12, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
4c078fa5

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

11 Feb, 2026 1 commit
- [CI][BugFix] Fix silent failure in shellcheck hook and baseline exist… (#32458) · fa7e0bfa
  junuxyz authored Feb 12, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  fa7e0bfa
10 Feb, 2026 1 commit
- [Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271) · c4b9e677
  Tyler Michael Smith authored Feb 10, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c4b9e677
09 Feb, 2026 1 commit
- [Doc] Add DCP support to attention backend doc (#33936) · 5e75a14a
  Michael Goin authored Feb 09, 2026
  
  5e75a14a
07 Feb, 2026 1 commit

Update DeepGEMM version pin in Dockerfile to match #32479 (#33935) · 52181baa

zifeitong authored Feb 07, 2026

Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

52181baa

06 Feb, 2026 1 commit
- Consolidate and fix forbidden import `pre-commit` checks (#33982) · 791a94be
  Harry Mellor authored Feb 06, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  791a94be
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
30 Jan, 2026 1 commit
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972