Commits · 04b5f9802da90f27636549677ec280d34236a51d · OpenDAS / vllm_cscc

14 Oct, 2025 1 commit
- [CI] Raise VLLM_MAX_SIZE_MB to 500 due to failing Build wheel - CUDA 12.9 (#26722) · 04b5f980
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  04b5f980
11 Oct, 2025 2 commits
- [XPU] Upgrade NIXL to remove CUDA dependency (#26570) · 27ed39a3
  liuzhenwei authored Oct 11, 2025
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  27ed39a3
- [CI/Build] Fix ppc64le CPU build and tests (#22443) · 8f8474fb
  Nishidha Panpaliya authored Oct 11, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  8f8474fb
09 Oct, 2025 3 commits
- [UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60
  Michael Goin authored Oct 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c9d33c60
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7
- Update Dockerfile and install runai-model-streamer[gcs] package (#26464) · 0d7c3cb5
  pwschuurman authored Oct 08, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  0d7c3cb5
08 Oct, 2025 1 commit
- Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) · e09d1753
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e09d1753
07 Oct, 2025 1 commit
- [Misc] Define EP kernel arch list in Dockerfile (#25635) · 8229280a
  Simon Mo authored Oct 06, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
```
  8229280a
03 Oct, 2025 1 commit
- [Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) · 27edd2ae
  Tyler Michael Smith authored Oct 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  27edd2ae
02 Oct, 2025 2 commits
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
- Update base image to 22.04 (jammy) (#26065) · d4e7a115
  Huy Do authored Oct 02, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  d4e7a115
01 Oct, 2025 1 commit
- [ROCm][Build] Add support for AMD Ryzen AI MAX / AI 300 Series (#25908) · aac622e0
  Hosang authored Oct 01, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  aac622e0
30 Sep, 2025 1 commit

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76

29 Sep, 2025 1 commit
- update to latest deepgemm for dsv3.2 (#25871) · 9360d34f
  youkaichao authored Sep 29, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  9360d34f
27 Sep, 2025 3 commits
- [Bug]: Set LD_LIBRARY_PATH to include the 'standard' CUDA location (#25766) · 5546acb4
  Clayton Coleman authored Sep 27, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  5546acb4
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) · 92da847c
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  92da847c
26 Sep, 2025 1 commit
- [CI] Fix FlashInfer AOT in release docker image (#25730) · cf892028
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf892028
25 Sep, 2025 1 commit
- [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652) · eb32335e
  Li, Jiang authored Sep 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eb32335e
24 Sep, 2025 1 commit
- [ROCm][Build][Bugfix] Fix ROCm base docker whls installation order (#25415) · 302eb941
  Gregory Shtrasberg authored Sep 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  302eb941
18 Sep, 2025 1 commit
- [ROCm][CI/Build] Use ROCm7.0 as the base (#25178) · dc340593
  Gregory Shtrasberg authored Sep 18, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc340593
17 Sep, 2025 1 commit

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

16 Sep, 2025 1 commit

Upgrade flashinfer to 0.3.1 (#24470) · 0af3ce13

Lu Fang authored Sep 15, 2025


Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

0af3ce13

15 Sep, 2025 2 commits
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
10 Sep, 2025 1 commit

[CI/Build] bump timm dependency (#24189) · 2f5e5c18

Daniele authored Sep 10, 2025


Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2f5e5c18

09 Sep, 2025 2 commits
- [ROCm][Feature] Enable Pipeline Parallelism with Ray Compiled Graph on ROCm (#24275) · 73e688cb
  Charlie Fu authored Sep 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  73e688cb
- [ROCm][CI/Build] Sync ROCm dockerfiles with the ROCm fork (#24279) · b9a1c4c8
  Gregory Shtrasberg authored Sep 09, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  b9a1c4c8
08 Sep, 2025 2 commits
- [Hardware][IBM Z] Fix Outlines Core issue for s390x (#24034) · e10fef08
  R3hankhan authored Sep 09, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  e10fef08
- [xpu] upgrade ipex/python3.12 for xpu (#23830) · 67841317
  Yan Ma authored Sep 08, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  67841317
06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
04 Sep, 2025 2 commits

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) · 4ba0c587
  dongbo910220 authored Sep 03, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  4ba0c587
01 Sep, 2025 1 commit

[Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318

Jee Jee Li authored Sep 01, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc1a5318

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
22 Aug, 2025 2 commits
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 1 commit

Always use cache mounts when installing vllm to avoid populating pip cache in... · 8ef6b8a3

tvalentyn authored Aug 22, 2025


Always use cache mounts when installing vllm to avoid populating pip cache in the image. Also remove apt cache. (#23270)
Signed-off-by: Valentyn Tymofieiev <valentyn@google.com>

8ef6b8a3