Commits · e5017cd6d62cfe82aafb967b2575f4d9f1388e8f · OpenDAS / vllm_cscc

02 Oct, 2025 2 commits
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
- Update base image to 22.04 (jammy) (#26065) · d4e7a115
  Huy Do authored Oct 02, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  d4e7a115
29 Sep, 2025 1 commit
- update to latest deepgemm for dsv3.2 (#25871) · 9360d34f
  youkaichao authored Sep 29, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9360d34f
27 Sep, 2025 3 commits
- [Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (#25766) · 5546acb4
  Clayton Coleman authored Sep 27, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  5546acb4
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) · 92da847c
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  92da847c
26 Sep, 2025 1 commit
- [CI] Fix FlashInfer AOT in release docker image (#25730) · cf892028
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf892028
17 Sep, 2025 1 commit

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

15 Sep, 2025 2 commits
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
10 Sep, 2025 1 commit

[CI/Build] bump timm dependency (#24189) · 2f5e5c18

Daniele authored Sep 10, 2025


Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2f5e5c18

04 Sep, 2025 2 commits

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) · 4ba0c587
  dongbo910220 authored Sep 03, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  4ba0c587
01 Sep, 2025 1 commit

[Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318

Jee Jee Li authored Sep 01, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc1a5318

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
22 Aug, 2025 1 commit
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
20 Aug, 2025 1 commit
- Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) · 50df09fe
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  50df09fe
15 Aug, 2025 2 commits
- ci: Add CUDA + arm64 release builds (#21201) · 76144adf
  Eli Uriegas authored Aug 15, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  76144adf
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f
12 Aug, 2025 2 commits
- [Bugfix] Bump DeepGEMM Version to Fix SMXX Layout Issues (#22606) · ba81acbd
  Frank Wang authored Aug 12, 2025
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  ba81acbd
- Upgrade FlashInfer to v0.2.11 (#22613) · dc5e4a65
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  dc5e4a65
10 Aug, 2025 1 commit
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b
07 Aug, 2025 1 commit
- Update `flashinfer-python==0.2.10` (#22389) · e8961e96
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e8961e96
05 Aug, 2025 2 commits
- [CI/Build] Update flashinfer to 0.2.9 (#22233) · a7cb6101
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a7cb6101
- Use UV_LINK_MODE=copy in Dockerfile to avoid hardlink fail (#22128) · c494f96f
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c494f96f
01 Aug, 2025 2 commits
- Revert precompile wheel changes (#22055) · da31f6ad
  Simon Mo authored Aug 01, 2025
  
  da31f6ad
- Add DeepGEMM to Dockerfile in vllm-base image (#21533) · e360316a
  Matthew Bonanni authored Jul 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  e360316a
31 Jul, 2025 2 commits
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
- [CI/Build] get rid of unused VLLM_FA_CMAKE_GPU_ARCHES (#21599) · d2aab336
  Daniele authored Jul 31, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  d2aab336
29 Jul, 2025 2 commits
- docker: docker-aware precompiled wheel support (#21127) · a1873db2
  Doug Smith authored Jul 29, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  a1873db2
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
28 Jul, 2025 1 commit
- update flashinfer to v0.2.9rc2 (#21701) · 01c753ed
  weiliang authored Jul 29, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  01c753ed
24 Jul, 2025 4 commits
- update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
  weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  2dd72d23
- [Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
  elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5a19a6c6
- bump `flashinfer` to `v0.2.8` (#21385) · 526078a9
  cjackal authored Jul 24, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  526078a9
- [Bugfix] Fix casing warning (#21468) · aa08a954
  Matthew Bonanni authored Jul 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aa08a954
21 Jul, 2025 1 commit
- [CI] Cleanup modelscope version constraint in Dockerfile (#21243) · 8188196a
  Kay Yan authored Jul 21, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  8188196a
17 Jul, 2025 1 commit
- [Docker] Allow FlashInfer to be built in the ARM CUDA Dockerfile (#21013) · a50d9182
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a50d9182