Commits · 22b42b5402f887c7d4b9f9aa4e82c970a6fd11a9 · OpenDAS / vllm_cscc

24 Nov, 2025 1 commit
- [CI/Build] Moves to cuda-base runtime image while retaining minimal JIT dependencies (#29270) · 4d6afcad
  Benjamin Bartels authored Nov 24, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  4d6afcad
22 Nov, 2025 1 commit
- [CI/build] Removes source compilation from runtime image (#26966) · eb5352a7
  Benjamin Bartels authored Nov 22, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  eb5352a7
21 Nov, 2025 3 commits
- Revert "Revert #28875 (#29159)" (#29179) · 94528630
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  94528630
- Revert #28875 (#29159) · 4d7231e7
  Cyrus Leung authored Nov 21, 2025
  
  4d7231e7
- [Doc] update installation guide regarding aarch64+cuda pytorch build (#28875) · 698024ec
  Qidong Su authored Nov 20, 2025
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  698024ec
08 Nov, 2025 1 commit
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
30 Oct, 2025 2 commits

Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) · ba33e883
Huy Do authored Oct 30, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
ba33e883

[Feat] Adds runai distributed streamer (#27230) · 17d055f5

Benjamin Bartels authored Oct 30, 2025


Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

17d055f5

29 Oct, 2025 2 commits
- Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) · 9007bf57
  Simon Mo authored Oct 28, 2025
  
  9007bf57
- Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) · f2575447
  Huy Do authored Oct 28, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f2575447
21 Oct, 2025 2 commits
- Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
  Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  becb7de4
- [CI] Install pre-release version of `apache-tvm-ffi` for `flashinfer` (#27262) · bd66b852
  Harry Mellor authored Oct 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bd66b852
16 Oct, 2025 1 commit
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
14 Oct, 2025 1 commit
- [CI] Raise VLLM_MAX_SIZE_MB to 500 due to failing Build wheel - CUDA 12.9 (#26722) · 04b5f980
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04b5f980
09 Oct, 2025 3 commits
- [UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60
  Michael Goin authored Oct 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c9d33c60
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7
- Update Dockerfile and install runai-model-streamer[gcs] package (#26464) · 0d7c3cb5
  pwschuurman authored Oct 08, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  0d7c3cb5
07 Oct, 2025 1 commit
- [Misc] Define EP kernel arch list in Dockerfile (#25635) · 8229280a
  Simon Mo authored Oct 06, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
```
  8229280a
03 Oct, 2025 1 commit
- [Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) · 27edd2ae
  Tyler Michael Smith authored Oct 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  27edd2ae
02 Oct, 2025 2 commits
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
- Update base image to 22.04 (jammy) (#26065) · d4e7a115
  Huy Do authored Oct 02, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  d4e7a115
29 Sep, 2025 1 commit
- update to latest deepgemm for dsv3.2 (#25871) · 9360d34f
  youkaichao authored Sep 29, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9360d34f
27 Sep, 2025 3 commits
- [Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (#25766) · 5546acb4
  Clayton Coleman authored Sep 27, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  5546acb4
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) · 92da847c
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  92da847c
26 Sep, 2025 1 commit
- [CI] Fix FlashInfer AOT in release docker image (#25730) · cf892028
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf892028
17 Sep, 2025 1 commit

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

15 Sep, 2025 2 commits
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
10 Sep, 2025 1 commit

[CI/Build] bump timm dependency (#24189) · 2f5e5c18

Daniele authored Sep 10, 2025


Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2f5e5c18

04 Sep, 2025 2 commits

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) · 4ba0c587
  dongbo910220 authored Sep 03, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  4ba0c587
01 Sep, 2025 1 commit

[Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318

Jee Jee Li authored Sep 01, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc1a5318

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
22 Aug, 2025 1 commit
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
20 Aug, 2025 1 commit
- Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) · 50df09fe
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  50df09fe
15 Aug, 2025 2 commits
- ci: Add CUDA + arm64 release builds (#21201) · 76144adf
  Eli Uriegas authored Aug 15, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  76144adf
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f