Commits · d346ec695ef5dc74cde338a6bc3857e91c311ab2 · OpenDAS / vllm_cscc

27 Sep, 2025 2 commits
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) · 92da847c
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  92da847c
26 Sep, 2025 1 commit
- [CI] Fix FlashInfer AOT in release docker image (#25730) · cf892028
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf892028
25 Sep, 2025 1 commit
- [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652) · eb32335e
  Li, Jiang authored Sep 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eb32335e
24 Sep, 2025 1 commit
- [ROCm][Build][Bugfix] Fix ROCm base docker whls installation order (#25415) · 302eb941
  Gregory Shtrasberg authored Sep 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  302eb941
18 Sep, 2025 1 commit
- [ROCm][CI/Build] Use ROCm7.0 as the base (#25178) · dc340593
  Gregory Shtrasberg authored Sep 18, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc340593
17 Sep, 2025 1 commit

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

16 Sep, 2025 1 commit

Upgrade flashinfer to 0.3.1 (#24470) · 0af3ce13

Lu Fang authored Sep 15, 2025


Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

0af3ce13

15 Sep, 2025 2 commits
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
10 Sep, 2025 1 commit

[CI/Build] bump timm dependency (#24189) · 2f5e5c18

Daniele authored Sep 10, 2025


Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2f5e5c18

09 Sep, 2025 2 commits
- [ROCm][Feature] Enable Pipeline Parallelism with Ray Compiled Graph on ROCm (#24275) · 73e688cb
  Charlie Fu authored Sep 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  73e688cb
- [ROCm][CI/Build] Sync ROCm dockerfiles with the ROCm fork (#24279) · b9a1c4c8
  Gregory Shtrasberg authored Sep 09, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  b9a1c4c8
08 Sep, 2025 2 commits
- [Hardware][IBM Z] Fix Outlines Core issue for s390x (#24034) · e10fef08
  R3hankhan authored Sep 09, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  e10fef08
- [xpu] upgrade ipex/python3.12 for xpu (#23830) · 67841317
  Yan Ma authored Sep 08, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  67841317
06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
04 Sep, 2025 2 commits

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) · 4ba0c587
  dongbo910220 authored Sep 03, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  4ba0c587
01 Sep, 2025 1 commit

[Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318

Jee Jee Li authored Sep 01, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc1a5318

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
22 Aug, 2025 2 commits
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 1 commit

Always use cache mounts when installing vllm to avoid populating pip cache in... · 8ef6b8a3

tvalentyn authored Aug 22, 2025


Always use cache mounts when installing vllm to avoid populating pip cache in the image. Also remove apt cache. (#23270)
Signed-off-by: Valentyn Tymofieiev <valentyn@google.com>

8ef6b8a3

20 Aug, 2025 1 commit
- Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) · 50df09fe
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  50df09fe
19 Aug, 2025 1 commit
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
15 Aug, 2025 2 commits
- ci: Add CUDA + arm64 release builds (#21201) · 76144adf
  Eli Uriegas authored Aug 15, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  76144adf
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f
12 Aug, 2025 2 commits
- [Bugfix] Bump DeepGEMM Version to Fix SMXX Layout Issues (#22606) · ba81acbd
  Frank Wang authored Aug 12, 2025
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  ba81acbd
- Upgrade FlashInfer to v0.2.11 (#22613) · dc5e4a65
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  dc5e4a65
10 Aug, 2025 1 commit
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b
09 Aug, 2025 1 commit
- [XPU] upgrade torch 2.8 on for XPU (#22300) · 81c57f60
  Kunshang Ji authored Aug 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  81c57f60
07 Aug, 2025 1 commit
- Update `flashinfer-python==0.2.10` (#22389) · e8961e96
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e8961e96
05 Aug, 2025 2 commits
- [CI/Build] Update flashinfer to 0.2.9 (#22233) · a7cb6101
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a7cb6101
- Use UV_LINK_MODE=copy in Dockerfile to avoid hardlink fail (#22128) · c494f96f
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c494f96f
01 Aug, 2025 2 commits
- Revert precompile wheel changes (#22055) · da31f6ad
  Simon Mo authored Aug 01, 2025
  
  da31f6ad
- Add DeepGEMM to Dockerfile in vllm-base image (#21533) · e360316a
  Matthew Bonanni authored Jul 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  e360316a
31 Jul, 2025 2 commits
- Update torch_xla pin to 20250730 (#21956) · 53c21e49
  XiongfeiWei authored Jul 31, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  53c21e49
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021