Commits · b36adfa349cfab0e79f3d736d5e5413bd3ee19f5 · OpenDAS / vllm_cscc

17 Mar, 2026 2 commits
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
16 Mar, 2026 1 commit
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 4 commits

Update Flashinfer to 0.6.6 (#36768) · cc16b24b

Dimitrios Bariamis authored Mar 12, 2026


Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>

cc16b24b

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

[CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf

Martin Hickey authored Mar 12, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7f1f36bf

replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
894843eb

09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
07 Mar, 2026 1 commit
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 2 commits

[MISC] fixed tool_parser mypy errors (#35640) · 1aaec59d

Taneem Ibrahim authored Mar 04, 2026

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1aaec59d

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit
- [ROCm] [Release] Change the package from `aiter` to `amd-aiter` (#35198) · 5dfc5abe
  TJian authored Mar 03, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  5dfc5abe
02 Mar, 2026 1 commit

[CI] Fix mypy for vllm/device allocator (#35518) · 7560d674

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7560d674

01 Mar, 2026 2 commits

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

[MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
59d7af9c

27 Feb, 2026 2 commits

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896

26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

21 Feb, 2026 1 commit
- [Misc] Fix mypy errors in vllm/profiler and remove from exclude list (#34959) · d38cd3dd
  Taneem Ibrahim authored Feb 20, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  d38cd3dd
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [CI] Enable mypy import following for vllm/v1/kv_offload (#34639) · 0b5f9b72
  Aneesh Puttur authored Feb 16, 2026
```
Signed-off-by: Aneesh Puttur <aneeshputtur@gmail.com>
```
  0b5f9b72
16 Feb, 2026 1 commit

[CI] Enable mypy coverage for individual excluded files (#34292) · a3205bef

Lucas Kabela authored Feb 16, 2026


Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a3205bef

12 Feb, 2026 2 commits

[ROCm][CI] Pin TorchCodec to v0.10.0 for ROCm compatibility (#34447) · 4c078fa5
Andreas Karatzas authored Feb 12, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
4c078fa5

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

11 Feb, 2026 1 commit
- [CI][BugFix] Fix silent failure in shellcheck hook and baseline exist… (#32458) · fa7e0bfa
  junuxyz authored Feb 12, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  fa7e0bfa
10 Feb, 2026 1 commit
- [Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271) · c4b9e677
  Tyler Michael Smith authored Feb 10, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c4b9e677
09 Feb, 2026 1 commit
- [Doc] Add DCP support to attention backend doc (#33936) · 5e75a14a
  Michael Goin authored Feb 09, 2026
  
  5e75a14a
07 Feb, 2026 1 commit

Update DeepGEMM version pin in Dockerfile to match #32479 (#33935) · 52181baa

zifeitong authored Feb 07, 2026

Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

52181baa

06 Feb, 2026 1 commit
- Consolidate and fix forbidden import `pre-commit` checks (#33982) · 791a94be
  Harry Mellor authored Feb 06, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  791a94be
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
30 Jan, 2026 1 commit
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
29 Jan, 2026 2 commits
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
- [Release] [CI] Optim release pipeline (#33156) · f9d03599
  TJian authored Jan 29, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  f9d03599
28 Jan, 2026 2 commits
- [7/N][Attention][Docs] Add documentation for attention backends (#32477) · 77c4f45c
  Matthew Bonanni authored Jan 28, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77c4f45c
- [CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f1acbd68
27 Jan, 2026 1 commit
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
23 Jan, 2026 1 commit
- [CI] Fix mypy for `vllm/v1/structured_output` (#32722) · 7ef58737
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7ef58737
22 Jan, 2026 2 commits
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1