Commits · a3e2e250f09d7a347cfdccfe2f7b593edd1b7bce · OpenDAS / vllm_cscc

15 Mar, 2026 2 commits
- [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) · a3e2e250
  Hari authored Mar 15, 2026
```
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
```
  a3e2e250
- [Frontend] Remove `torchcodec` from audio dependency (#37061) · 6590a3ec
  Isotr0py authored Mar 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6590a3ec
14 Mar, 2026 4 commits
- [Feature] Add InstantTensor weight loader (#36139) · 8c29042b
  arlo authored Mar 15, 2026
  
  8c29042b
- [Bugfix][Frontend] Fix audio transcription for MP4, M4A, and WebM formats (#35109) · 84868e47
  seanmamasde authored Mar 14, 2026
```
Signed-off-by: seanmamasde <seanmamasde@gmail.com>
```
  84868e47
- [CI] Pin helion version (#37012) · 236de72e
  Yanan Cao authored Mar 13, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  236de72e
- [UX] Improve UX of CPU backend (#36968) · 092ace9e
  Li, Jiang authored Mar 14, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  092ace9e
13 Mar, 2026 1 commit
- build: update smg-grpc-servicer to use vllm extra (#36938) · 572c776b
  Simo Lin authored Mar 12, 2026
```
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
```
  572c776b
10 Mar, 2026 1 commit

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc... · 507ddbe9

Chang Su authored Mar 10, 2026

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc flag to vllm serve (#36169)
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

507ddbe9

04 Mar, 2026 1 commit

Support Audio Extraction from MP4 Video for Nemotron Nano VL (#35539) · 5d199ac8

Andrii Skliar authored Mar 04, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Andrii <askliar@nvidia.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Andrii Skliar <askliar@oci-nrt-cs-001-vscode-01.cm.cluster>
Co-authored-by: Andrii <askliar@nvidia.com>
Co-authored-by: root <root@pool0-03748.cm.cluster>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: root <root@pool0-02416.cm.cluster>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: root <root@pool0-04880.cm.cluster>

5d199ac8

01 Mar, 2026 1 commit

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

28 Feb, 2026 1 commit
- [CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
  Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
  90805ff4
26 Feb, 2026 1 commit
- [Benchmarks] Plot benchmark timeline and requests statistics (#35220) · 02acd168
  Sophie du Couédic authored Feb 26, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  02acd168
11 Feb, 2026 1 commit
- [Misc] Bump `fastsafetensors` version for latest fixes (#34273) · 79504027
  Nick Hill authored Feb 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  79504027
06 Feb, 2026 1 commit
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
24 Jan, 2026 1 commit

[Dev UX] Add auto-detection for VLLM_PRECOMPILED_WHEEL_VARIANT during install (#32948) · d0cbac58

Michael Goin authored Jan 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Shengqi Chen <i@harrychen.xyz>

d0cbac58

22 Jan, 2026 1 commit
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
19 Jan, 2026 1 commit
- [CI] Add Helion as an optional dependency (#32482) · 9d1e611f
  Yanan Cao authored Jan 19, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  9d1e611f
11 Jan, 2026 1 commit
- [Misc] Make `scipy` as optional audio/benchmark dependency (#32096) · cee7436a
  Isotr0py authored Jan 11, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cee7436a
09 Jan, 2026 1 commit
- [CI] [ROCm] Fix `tests/entrypoints/test_grpc_server.py` on ROCm (#31970) · 7a05d2dc
  TJian authored Jan 09, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  7a05d2dc
08 Jan, 2026 1 commit

[grpc] Support gRPC server entrypoint (#30190) · 791b2fc3

Chang Su authored Jan 07, 2026


Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

791b2fc3

29 Dec, 2025 1 commit

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

24 Dec, 2025 1 commit
- [ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979) · 0247a91e
  Andreas Karatzas authored Dec 24, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0247a91e
04 Dec, 2025 1 commit
- Validating Runai Model Streamer Integration with S3 Object Storage (#29320) · 6366c098
  Noa Neria authored Dec 04, 2025
```
Signed-off-by: Noa Neria <noa@run.ai>
```
  6366c098
03 Dec, 2025 2 commits
- [CI] fix docker image build by specifying merge-base commit id when... · 1109f982
  Shengqi Chen authored Dec 04, 2025
```
[CI] fix docker image build by specifying merge-base commit id when downloading pre-compiled wheels (#29930)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  1109f982
- [docker] Build CUDA kernels in separate Docker stage for faster rebuilds (#29452) · f5d3d93c
  Amr Mahdi authored Dec 03, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
  f5d3d93c
02 Dec, 2025 1 commit
- [CI] Renovation of nightly wheel build & generation (take 2) (#29838) · 4b612664
  Shengqi Chen authored Dec 02, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  4b612664
01 Dec, 2025 3 commits
- Revert #29787 and #29690 (#29815) · 1336a1ea
  Kevin H. Luu authored Dec 01, 2025
  
  1336a1ea
- [CI] fix url-encoding behavior in nightly metadata generation (#29787) · 37593deb
  Shengqi Chen authored Dec 01, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  37593deb
- [CI] Renovation of nightly wheel build & generation (#29690) · 36db0a35
  Shengqi Chen authored Dec 01, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  36db0a35
28 Nov, 2025 1 commit
- [CI/Build]: make it possible to build with a free-threaded interpreter (#29241) · 7c1ed458
  Ralf Gommers authored Nov 29, 2025
```
Signed-off-by: Ralf Gommers <ralf.gommers@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7c1ed458
22 Nov, 2025 1 commit
- fix: clean up function never use in setup.py (#29061) · 2d4978a5
  yihong authored Nov 22, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2d4978a5
19 Nov, 2025 1 commit

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc

13 Nov, 2025 1 commit
- [TPU] patch TPU wheel build script to resolve metadata issue (#27279) · fdfd5075
  Johnny Yang authored Nov 13, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  fdfd5075
12 Nov, 2025 1 commit

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

4ca5cd57

30 Oct, 2025 1 commit

[Feat] Adds runai distributed streamer (#27230) · 17d055f5

Benjamin Bartels authored Oct 30, 2025


Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

17d055f5

29 Oct, 2025 1 commit

[Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee

Cyrus Leung authored Oct 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ecca3fee

12 Oct, 2025 1 commit
- [CI/Build] Add tool to build vllm-tpu wheel (#19165) · 7ef60528
  Michael Goin authored Oct 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7ef60528
09 Oct, 2025 2 commits

[UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60

Michael Goin authored Oct 09, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c9d33c60

Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
5e49c3e7

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb