Commits · 4d51588e2381018348f1022dfa3a7698899805b7 · OpenDAS / vllm_cscc

27 Apr, 2026 1 commit

[Feat] DeepSeek V4 Rebased (#40860) · 4d51588e

Yifan Qiao authored Apr 26, 2026


Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: qizixi <zixi@inferact.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Zhewen Li <jerven.vllm@gmail.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: qizixi <zixi@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

4d51588e

24 Apr, 2026 2 commits
- [Attention] use diff kv backend for mimo v2 flash (#40045) · e8ee2a78
  Jiangyun Zhu authored Apr 24, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e8ee2a78
- [Misc] Added curl retries in install_python_libraries.sh (#36700) · 30413442
  Dmitry Tokarev authored Apr 23, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  30413442
23 Apr, 2026 1 commit
- [NVIDIA] Add sm_110 (Jetson Thor) to CUDA 13.0 build targets (#39233) · 7f95a66c
  Johnny authored Apr 23, 2026
  
  7f95a66c
22 Apr, 2026 1 commit
- [MyPy] Enable mypy for `vllm/model_executor/layers/` (#40159) · 3951d3ea
  Martin Hickey authored Apr 22, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  3951d3ea
21 Apr, 2026 1 commit

Revert #38730 and #38791 (#40032) · 6d85b36a

Vadim Gimpelson authored Apr 21, 2026


Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

6d85b36a

10 Apr, 2026 2 commits

Add structure to `requirements/` directory (#39024) · fc645f1a

Harry Mellor authored Apr 10, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

fc645f1a

Add platform manual_seed_all API (#38468) · ec68d53b
Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
ec68d53b

09 Apr, 2026 2 commits

[CI] Fix mypy for `vllm/v1/ops` (#39219) · aec18492
Wentao Ye authored Apr 08, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
aec18492

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe

Michael Goin authored Apr 09, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

eb4205fe

01 Apr, 2026 2 commits
- [Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730) · 6183cae1
  Stefano Castagnetta authored Apr 01, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  6183cae1
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
31 Mar, 2026 2 commits

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

[Bugfix] Fix for builtins (forward fix of pytorch/177558) (#37234) · e3191506
Lucas Kabela authored Mar 30, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
e3191506

29 Mar, 2026 1 commit
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
28 Mar, 2026 1 commit
- [ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413) · 58a249bc
  TJian authored Mar 28, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  58a249bc
24 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/model_executor` (except `vllm/model_executor/layers`) (#37904) · b3601da6
  Harry Mellor authored Mar 24, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3601da6
23 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/config` (#37808) · 45bd5c8e
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  45bd5c8e
17 Mar, 2026 2 commits
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
16 Mar, 2026 1 commit
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 4 commits

Update Flashinfer to 0.6.6 (#36768) · cc16b24b

Dimitrios Bariamis authored Mar 12, 2026


Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>

cc16b24b

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

[CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf

Martin Hickey authored Mar 12, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7f1f36bf

replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
894843eb

09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
07 Mar, 2026 1 commit
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 2 commits

[MISC] fixed tool_parser mypy errors (#35640) · 1aaec59d

Taneem Ibrahim authored Mar 04, 2026

Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1aaec59d

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit
- [ROCm] [Release] Change the package from `aiter` to `amd-aiter` (#35198) · 5dfc5abe
  TJian authored Mar 03, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  5dfc5abe
02 Mar, 2026 1 commit

[CI] Fix mypy for vllm/device allocator (#35518) · 7560d674

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7560d674

01 Mar, 2026 2 commits

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

[MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
59d7af9c

27 Feb, 2026 2 commits

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896

26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

21 Feb, 2026 1 commit
- [Misc] Fix mypy errors in vllm/profiler and remove from exclude list (#34959) · d38cd3dd
  Taneem Ibrahim authored Feb 20, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  d38cd3dd
17 Feb, 2026 2 commits
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
- [CI] Enable mypy import following for vllm/v1/kv_offload (#34639) · 0b5f9b72
  Aneesh Puttur authored Feb 16, 2026
```
Signed-off-by: Aneesh Puttur <aneeshputtur@gmail.com>
```
  0b5f9b72