Commits · cc16b24b17986c1983e3f30c0438e52b0328f9bd · OpenDAS / vllm_cscc

12 Mar, 2026 4 commits

Update Flashinfer to 0.6.6 (#36768) · cc16b24b

Dimitrios Bariamis authored Mar 12, 2026


Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>

cc16b24b

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

[CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf

Martin Hickey authored Mar 12, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7f1f36bf

replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
894843eb

09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
07 Mar, 2026 1 commit
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 2 commits

[MISC] fixed tool_parser mypy errors (#35640) · 1aaec59d

Taneem Ibrahim authored Mar 04, 2026

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1aaec59d

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

02 Mar, 2026 1 commit

[CI] Fix mypy for vllm/device allocator (#35518) · 7560d674

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7560d674

01 Mar, 2026 2 commits

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

[MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
59d7af9c

27 Feb, 2026 1 commit

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

21 Feb, 2026 1 commit
- [Misc] Fix mypy errors in vllm/profiler and remove from exclude list (#34959) · d38cd3dd
  Taneem Ibrahim authored Feb 20, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  d38cd3dd
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [CI] Enable mypy import following for vllm/v1/kv_offload (#34639) · 0b5f9b72
  Aneesh Puttur authored Feb 16, 2026
```
Signed-off-by: Aneesh Puttur <aneeshputtur@gmail.com>
```
  0b5f9b72
16 Feb, 2026 1 commit

[CI] Enable mypy coverage for individual excluded files (#34292) · a3205bef

Lucas Kabela authored Feb 16, 2026


Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a3205bef

12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

11 Feb, 2026 1 commit
- [CI][BugFix] Fix silent failure in shellcheck hook and baseline exist… (#32458) · fa7e0bfa
  junuxyz authored Feb 12, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  fa7e0bfa
10 Feb, 2026 1 commit
- [Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271) · c4b9e677
  Tyler Michael Smith authored Feb 10, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c4b9e677
09 Feb, 2026 1 commit
- [Doc] Add DCP support to attention backend doc (#33936) · 5e75a14a
  Michael Goin authored Feb 09, 2026
  
  5e75a14a
06 Feb, 2026 1 commit
- Consolidate and fix forbidden import `pre-commit` checks (#33982) · 791a94be
  Harry Mellor authored Feb 06, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  791a94be
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
30 Jan, 2026 1 commit
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
29 Jan, 2026 1 commit
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
28 Jan, 2026 2 commits
- [7/N][Attention][Docs] Add documentation for attention backends (#32477) · 77c4f45c
  Matthew Bonanni authored Jan 28, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77c4f45c
- [CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f1acbd68
27 Jan, 2026 1 commit
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
23 Jan, 2026 1 commit
- [CI] Fix mypy for `vllm/v1/structured_output` (#32722) · 7ef58737
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7ef58737
22 Jan, 2026 2 commits
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
20 Jan, 2026 1 commit
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
15 Jan, 2026 1 commit
- [3/N] Group together media-related code (#32406) · 28459785
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  28459785
10 Jan, 2026 1 commit
- [2/N][Attention] Fix pre-commit errors (#32052) · 03089019
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  03089019
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
07 Jan, 2026 1 commit

fixed mypy warnings for files vllm/v1/attention with TEMPORARY workaround (#31465) · 0a2c2dc3

Jack Yang authored Jan 06, 2026


Signed-off-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0a2c2dc3

06 Jan, 2026 1 commit
- Fix RecursionError in MediaWithBytes unpickling (#31191) · ada6f91d
  Nikhil G authored Jan 06, 2026
```
Signed-off-by: Nikhil Ghosh <nikhil@anyscale.com>
```
  ada6f91d
12 Dec, 2025 1 commit
- [CI] Fix mypy for vllm/v1/executor (#30517) · 02a58803
  Wentao Ye authored Dec 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  02a58803
30 Nov, 2025 1 commit
- [Misc] Update `TokenizerLike` interface and move `get_cached_tokenizer` (#29730) · 2afcec4d
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2afcec4d
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427