Commits · 808d6fd7b97f71f64a14ad4eecb9afd7b4d9dcf8 · OpenDAS / vllm_cscc

21 Jan, 2026 1 commit
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
17 Dec, 2025 1 commit
- 2.9.1 PyTorch release update (#28495) · e06d0bf0
  Andrey Talman authored Dec 17, 2025
  
  e06d0bf0
27 Nov, 2025 1 commit

[BugFix] Fix `plan` API Mismatch when using latest FlashInfer (#29426) · a5345bf4

Andrii Skliar authored Nov 27, 2025


Signed-off-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
Co-authored-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>

a5345bf4

24 Nov, 2025 1 commit
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
14 Nov, 2025 1 commit
- [Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0aecd913
13 Nov, 2025 1 commit
- Use official xformers-0.0.33 built for PT 2.9 (#28600) · c33b87e7
  Huy Do authored Nov 12, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c33b87e7
08 Nov, 2025 1 commit
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
30 Oct, 2025 1 commit
- Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) · ba33e883
  Huy Do authored Oct 30, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  ba33e883
29 Oct, 2025 3 commits
- [Build] Revert triton_kernels requirements (#27659) · f6d5f588
  Varun Sundar Rabindranath authored Oct 29, 2025
  
  f6d5f588
- Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) · 9007bf57
  Simon Mo authored Oct 28, 2025
  
  9007bf57
- Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) · f2575447
  Huy Do authored Oct 28, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f2575447
23 Oct, 2025 1 commit

[Misc] Add triton_kernels dependency (#27370) · a9f55dc5

Varun Sundar Rabindranath authored Oct 23, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

a9f55dc5

21 Oct, 2025 1 commit
- Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
  Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  becb7de4
16 Oct, 2025 1 commit
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
09 Oct, 2025 1 commit

[UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60

Michael Goin authored Oct 09, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c9d33c60

08 Oct, 2025 1 commit
- Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) · e09d1753
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e09d1753
29 Aug, 2025 1 commit

Update PyTorch to 2.8.0 (#20358) · 67c14906

Huy Do authored Aug 29, 2025


Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

67c14906

03 Aug, 2025 1 commit
- [Misc] Bump ray to 2.48.0 (#22123) · 2ff46b88
  Rui Qiao authored Aug 02, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  2ff46b88
01 Aug, 2025 1 commit
- Move flashinfer-python to optional extra `vllm[flashinfer]` (#21959) · 0bd409cf
  Michael Goin authored Jul 31, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bd409cf
29 Jul, 2025 1 commit
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
17 Jul, 2025 1 commit
- Update PyTorch to `torch==2.7.1` for CUDA (#21011) · 4e7dfbe7
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4e7dfbe7
30 Apr, 2025 1 commit
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
10 Apr, 2025 1 commit
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
29 Mar, 2025 1 commit
- Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) · 8427f704
  cyyever authored Mar 29, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  8427f704
27 Mar, 2025 1 commit
- [Misc] Restrict ray version dependency and update PP feature warning in V1 (#15556) · df8d3d12
  Rui Qiao authored Mar 26, 2025
  
  df8d3d12
14 Mar, 2025 1 commit

Update to torch==2.6.0 (#12721) · 14f301b5

Michael Goin authored Mar 14, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

14f301b5

08 Mar, 2025 1 commit
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
05 Mar, 2025 1 commit
- Moved numba from common requirements to cuda/rocm specific requirements (#14199) · 5b143d33
  Nishidha authored Mar 05, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  5b143d33
28 Feb, 2025 1 commit
- [core] Bump ray to 2.43 (#13994) · 084bbac8
  Rui Qiao authored Feb 28, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  084bbac8
18 Feb, 2025 2 commits
- Pin Ray version to 2.40.0 (#13490) · c8d70e24
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8d70e24
- [V1][PP] Fix & Pin Ray version in requirements-cuda.txt (#13436) · 9915912f
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9915912f
09 Feb, 2025 1 commit
- [core] port pynvml into vllm codebase (#12963) · cf797aa8
  youkaichao authored Feb 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cf797aa8
29 Jan, 2025 1 commit

[Model] Refactoring of MiniCPM-V and add MiniCPM-o-2.6 support for vLLM (#12069) · d93bf4da

Alphi authored Jan 29, 2025


Signed-off-by: hzh <hezhihui_thu@163.com>
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Chenguang Li <757486878@qq.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Shanshan Shen <467638484@qq.com>
Signed-off-by: elijah <f1renze.142857@gmail.com>
Signed-off-by: Yikun <yikunkero@gmail.com>
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: shaochangxu <85155497+shaochangxu@users.noreply.github.com>
Co-authored-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: sixgod <evethwillbeok@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Akshat Tripathi <Akshat.tripathi6568@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Avshalom Manevich <12231371+avshalomman@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Yangcheng Li <liyangcheng.lyc@alibaba-inc.com>
Co-authored-by: Siyuan Li <94890248+liaoyanqing666@users.noreply.github.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: Chenguang Li <757486878@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: elijah <30852919+e1ijah1@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikunkero@gmail.com>
Co-authored-by: Steve Luo <36296769+SunflowerAries@users.noreply.github.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: TJian <tunjian1996@gmail.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Elfie Guo <164945471+elfiegg@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d93bf4da

20 Dec, 2024 2 commits

Add ray[default] to wget to run distributed inference out of box (#11265) · 47a0b615
Jiaxin Shan authored Dec 20, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
47a0b615

[ci][gh200] dockerfile clean up (#11351) · 7801f56e

youkaichao authored Dec 19, 2024


Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>

7801f56e

16 Dec, 2024 1 commit
- WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212) · b3b1526f
  cennn authored Dec 16, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
```
  b3b1526f
04 Nov, 2024 1 commit
- [Bugfix] Upgrade to pytorch 2.5.1 (#10001) · d93478b3
  bnellnm authored Nov 04, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  d93478b3
30 Oct, 2024 1 commit
- [Misc] Specify minimum pynvml version (#9827) · 6aa6020f
  Jee Jee Li authored Oct 30, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6aa6020f
27 Oct, 2024 1 commit

[Misc] Upgrade to pytorch 2.5 (#9588) · 3cb07a36

bnellnm authored Oct 27, 2024


Signed-off-by: Bill Nell <bill@neuralmagic.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3cb07a36

21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491