Commits · 39562a7fff621a97cdf5e03347afa02d8a433cef · OpenDAS / vllm_cscc

30 Jan, 2026 1 commit
- update version · 39562a7f
  zhuwenwen authored Jan 30, 2026
  
  39562a7f
11 Jan, 2026 1 commit
- [Misc] Make `scipy` as optional audio/benchmark dependency (#32096) · cee7436a
  Isotr0py authored Jan 11, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cee7436a
09 Jan, 2026 1 commit
- [CI] [ROCm] Fix `tests/entrypoints/test_grpc_server.py` on ROCm (#31970) · 7a05d2dc
  TJian authored Jan 09, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  7a05d2dc
08 Jan, 2026 1 commit

[grpc] Support gRPC server entrypoint (#30190) · 791b2fc3

Chang Su authored Jan 07, 2026


Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

791b2fc3

29 Dec, 2025 1 commit

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

24 Dec, 2025 1 commit
- [ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979) · 0247a91e
  Andreas Karatzas authored Dec 24, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0247a91e
04 Dec, 2025 1 commit
- Validating Runai Model Streamer Integration with S3 Object Storage (#29320) · 6366c098
  Noa Neria authored Dec 04, 2025
```
Signed-off-by: Noa Neria <noa@run.ai>
```
  6366c098
03 Dec, 2025 2 commits
- [CI] fix docker image build by specifying merge-base commit id when... · 1109f982
  Shengqi Chen authored Dec 04, 2025
```
[CI] fix docker image build by specifying merge-base commit id when downloading pre-compiled wheels (#29930)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  1109f982
- [docker] Build CUDA kernels in separate Docker stage for faster rebuilds (#29452) · f5d3d93c
  Amr Mahdi authored Dec 03, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
  f5d3d93c
02 Dec, 2025 1 commit
- [CI] Renovation of nightly wheel build & generation (take 2) (#29838) · 4b612664
  Shengqi Chen authored Dec 02, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  4b612664
01 Dec, 2025 3 commits
- Revert #29787 and #29690 (#29815) · 1336a1ea
  Kevin H. Luu authored Dec 01, 2025
  
  1336a1ea
- [CI] fix url-encoding behavior in nightly metadata generation (#29787) · 37593deb
  Shengqi Chen authored Dec 01, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  37593deb
- [CI] Renovation of nightly wheel build & generation (#29690) · 36db0a35
  Shengqi Chen authored Dec 01, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  36db0a35
28 Nov, 2025 1 commit
- [CI/Build]: make it possible to build with a free-threaded interpreter (#29241) · 7c1ed458
  Ralf Gommers authored Nov 29, 2025
```
Signed-off-by: Ralf Gommers <ralf.gommers@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7c1ed458
22 Nov, 2025 1 commit
- fix: clean up function never use in setup.py (#29061) · 2d4978a5
  yihong authored Nov 22, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2d4978a5
19 Nov, 2025 1 commit

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc

13 Nov, 2025 1 commit
- [TPU] patch TPU wheel build script to resolve metadata issue (#27279) · fdfd5075
  Johnny Yang authored Nov 13, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  fdfd5075
12 Nov, 2025 1 commit

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

4ca5cd57

30 Oct, 2025 1 commit

[Feat] Adds runai distributed streamer (#27230) · 17d055f5

Benjamin Bartels authored Oct 30, 2025


Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

17d055f5

29 Oct, 2025 2 commits

[Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee

Cyrus Leung authored Oct 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ecca3fee

remove major and minor of torch · c18b113d
zhuwenwen authored Oct 29, 2025

c18b113d

12 Oct, 2025 1 commit
- [CI/Build] Add tool to build vllm-tpu wheel (#19165) · 7ef60528
  Michael Goin authored Oct 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7ef60528
09 Oct, 2025 2 commits

[UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60

Michael Goin authored Oct 09, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c9d33c60

Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
5e49c3e7

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and... · 9705fba7

Fadi Arafeh authored Oct 04, 2025


[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and weight prepack (#25948)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

9705fba7

01 Oct, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

27 Sep, 2025 1 commit
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
15 Sep, 2025 2 commits
- [ci] fix wheel names for arm wheels (#24898) · fd2f1054
  Simon Mo authored Sep 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  fd2f1054
- Bump Flashinfer to 0.3.1 (#24868) · 94b03f88
  Benjamin Bartels authored Sep 15, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  94b03f88
14 Sep, 2025 1 commit
- update lora args · badc34b9
  zhuwenwen authored Sep 14, 2025
  
  badc34b9
10 Sep, 2025 2 commits

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

update setup.py · e005bce5
zhuwenwen authored Sep 10, 2025

e005bce5

06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
04 Sep, 2025 1 commit

Upgrade FlashInfer to v0.3.0 (#24086) · 78336a0c

Po-Han Huang (NVIDIA) authored Sep 05, 2025


Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

78336a0c

26 Aug, 2025 1 commit

Update Flashinfer to 0.2.14.post1 (#23537) · ae067888

weiliang authored Aug 26, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ae067888

23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

21 Aug, 2025 2 commits
- [ci/build] Fix abi tag for aarch64 (#23329) · e0b056e4
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e0b056e4
- update version · ff8507ce
  zhuwenwen authored Aug 21, 2025
  
  ff8507ce