Commits · 848562bd49a91d21f2dc76912d5fcb25ae80c8a8 · OpenDAS / vllm_cscc

04 Sep, 2025 2 commits

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- FIX: Add libnuma-dev to Dockerfile for dev stage (#20388) · 4ba0c587
  dongbo910220 authored Sep 03, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  4ba0c587
01 Sep, 2025 1 commit

[Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318

Jee Jee Li authored Sep 01, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc1a5318

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
22 Aug, 2025 2 commits
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 1 commit

Always use cache mounts when installing vllm to avoid populating pip cache in... · 8ef6b8a3

tvalentyn authored Aug 22, 2025


Always use cache mounts when installing vllm to avoid populating pip cache in the image. Also remove apt cache. (#23270)
Signed-off-by: Valentyn Tymofieiev <valentyn@google.com>

8ef6b8a3

20 Aug, 2025 1 commit
- Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) · 50df09fe
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  50df09fe
19 Aug, 2025 1 commit
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
15 Aug, 2025 2 commits
- ci: Add CUDA + arm64 release builds (#21201) · 76144adf
  Eli Uriegas authored Aug 15, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  76144adf
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f
12 Aug, 2025 2 commits
- [Bugfix] Bump DeepGEMM Version to Fix SMXX Layout Issues (#22606) · ba81acbd
  Frank Wang authored Aug 12, 2025
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  ba81acbd
- Upgrade FlashInfer to v0.2.11 (#22613) · dc5e4a65
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  dc5e4a65
10 Aug, 2025 1 commit
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b
09 Aug, 2025 1 commit
- [XPU] upgrade torch 2.8 on for XPU (#22300) · 81c57f60
  Kunshang Ji authored Aug 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  81c57f60
07 Aug, 2025 1 commit
- Update `flashinfer-python==0.2.10` (#22389) · e8961e96
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e8961e96
05 Aug, 2025 2 commits
- [CI/Build] Update flashinfer to 0.2.9 (#22233) · a7cb6101
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a7cb6101
- Use UV_LINK_MODE=copy in Dockerfile to avoid hardlink fail (#22128) · c494f96f
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c494f96f
01 Aug, 2025 2 commits
- Revert precompile wheel changes (#22055) · da31f6ad
  Simon Mo authored Aug 01, 2025
  
  da31f6ad
- Add DeepGEMM to Dockerfile in vllm-base image (#21533) · e360316a
  Matthew Bonanni authored Jul 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  e360316a
31 Jul, 2025 3 commits
- Update torch_xla pin to 20250730 (#21956) · 53c21e49
  XiongfeiWei authored Jul 31, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  53c21e49
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
- [CI/Build] get rid of unused VLLM_FA_CMAKE_GPU_ARCHES (#21599) · d2aab336
  Daniele authored Jul 31, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  d2aab336
29 Jul, 2025 2 commits
- docker: docker-aware precompiled wheel support (#21127) · a1873db2
  Doug Smith authored Jul 29, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  a1873db2
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
28 Jul, 2025 2 commits
- update flashinfer to v0.2.9rc2 (#21701) · 01c753ed
  weiliang authored Jul 29, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  01c753ed
- [Bugfix] Fix environment variable setting in CPU Dockerfile (#21730) · 65e8466c
  Li, Jiang authored Jul 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  65e8466c
26 Jul, 2025 1 commit
- [TPU] Update ptxla nightly version to 20250724 (#21555) · f1b286b2
  Chengji Yao authored Jul 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  f1b286b2
25 Jul, 2025 1 commit
- [CI] Unifying Dockerfiles for ARM and X86 Builds (#21343) · 396ee941
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  396ee941
24 Jul, 2025 5 commits
- update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
  weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  2dd72d23
- [Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
  elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5a19a6c6
- bump `flashinfer` to `v0.2.8` (#21385) · 526078a9
  cjackal authored Jul 24, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  526078a9
- [Bugfix] Fix casing warning (#21468) · aa08a954
  Matthew Bonanni authored Jul 23, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aa08a954
- [XPU][UT] increase intel xpu CI test scope (#21492) · 13e4ee1d
  Liangliang Ma authored Jul 24, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  13e4ee1d
21 Jul, 2025 1 commit
- [CI] Cleanup modelscope version constraint in Dockerfile (#21243) · 8188196a
  Kay Yan authored Jul 21, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  8188196a
17 Jul, 2025 3 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [TPU] Start using python 3.12 (#21000) · 58760e12
  XiongfeiWei authored Jul 16, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  58760e12