Commits · cca2d2cdbe56529205c10e58363c7bd2d31e15df · OpenDAS / vllm_cscc

20 Nov, 2025 2 commits
- [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) · 82b05b15
  TJian authored Nov 20, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  82b05b15
- [Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221) · 66483a9d
  cjackal authored Nov 20, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  66483a9d
19 Nov, 2025 2 commits

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c

[CPU] Refactor CPU WNA16 (#28826) · 20852c8f
Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
20852c8f

18 Nov, 2025 2 commits

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

Run macos smoke test workflow on main commit (#28752) · 88ab591f
Michael Goin authored Nov 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
88ab591f

14 Nov, 2025 4 commits

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0aecd913
[ROCm] Bump up the version of amd-smi to 6.4.3 (#28680) · 2aa75c75
Sage Moore authored Nov 13, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
2aa75c75

13 Nov, 2025 3 commits
- [Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791) · faed7bf0
  Kebe authored Nov 14, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  faed7bf0
- Use official xformers-0.0.33 built for PT 2.9 (#28600) · c33b87e7
  Huy Do authored Nov 12, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c33b87e7
- [ROCm][Bugfix] Revert removing setuptools version restriction (#28592) · d75ad048
  Gregory Shtrasberg authored Nov 12, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d75ad048
11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

09 Nov, 2025 1 commit
- fix: close issue 28338 by fixed python version (#28339) · 3a7d5803
  yihong authored Nov 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  3a7d5803
08 Nov, 2025 3 commits
- Remove setuptools upper bound constraint (<80) (#28337) · 32787d06
  Cole Murray authored Nov 08, 2025
```
Signed-off-by: Cole Murray <colemurray.cs@gmail.com>
```
  32787d06
- Bump arctic-inference requirement (#28174) · 781f5ebf
  Aurick Qiao authored Nov 07, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  781f5ebf
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
06 Nov, 2025 1 commit
- [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) · 5e0c1fe6
  Andy Lo authored Nov 06, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  5e0c1fe6
05 Nov, 2025 1 commit
- [Hardware][IBM Z] Optimize s390x Dockerfile (#28023) · e0449244
  R3hankhan authored Nov 06, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  e0449244
04 Nov, 2025 1 commit
- [CI/Build] Update LM Eval Version in AMD CI (#27944) · 2f84ae1f
  Zhewen Li authored Nov 03, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  2f84ae1f
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
01 Nov, 2025 2 commits

[Docs] Mock all imports for docs (#27873) · 799ce45c
Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
799ce45c

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

30 Oct, 2025 3 commits
- Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) · ba33e883
  Huy Do authored Oct 30, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  ba33e883
- [Feat] Adds runai distributed streamer (#27230) · 17d055f5
  Benjamin Bartels authored Oct 30, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17d055f5
- [XPU] Update latest IPEX 2.8 release (#27735) · b5bae42f
  Kunshang Ji authored Oct 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b5bae42f
29 Oct, 2025 3 commits
- [Build] Revert triton_kernels requirements (#27659) · f6d5f588
  Varun Sundar Rabindranath authored Oct 29, 2025
  
  f6d5f588
- Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) · 9007bf57
  Simon Mo authored Oct 28, 2025
  
  9007bf57
- Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) · f2575447
  Huy Do authored Oct 28, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f2575447
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
23 Oct, 2025 1 commit

[Misc] Add triton_kernels dependency (#27370) · a9f55dc5

Varun Sundar Rabindranath authored Oct 23, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

a9f55dc5

22 Oct, 2025 1 commit

Support Anthropic API /v1/messages Endpoint (#22627) · c9461e05

RED authored Oct 23, 2025


Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

c9461e05

21 Oct, 2025 3 commits
- Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
  Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  becb7de4
- [cpu] Dispatch un-quantized linear to oneDNN/ACL by default for AArch64 (#27183) · 163965d1
  Fadi Arafeh authored Oct 21, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Michael Yang <Michael.Yang@arm.com>
```
  163965d1
- [ROCm] enable some tests in entrypoints test groups on AMD (#26725) · 58fbbcb2
  Concurrensee authored Oct 20, 2025
```
Signed-off-by: Yida <yida.wu@amd.com>
```
  58fbbcb2
16 Oct, 2025 3 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- Cleanup code after Python 3.10 upgrade (#26520) · ed344f41
  Lukas Geiger authored Oct 16, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  ed344f41
- [CI/Build] Fix AMD import failures in CI (#26841) · 44c85556
  Zhewen Li authored Oct 16, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  44c85556
15 Oct, 2025 1 commit
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c