Commits · cffe15ef87c693f2839c7d31e5ea089ca7b18ce6 · OpenDAS / vllm_cscc

13 Dec, 2025 1 commit
- update deps，fix import and optional error, remove tc · cffe15ef
  zhuwenwen authored Dec 13, 2025
  
  cffe15ef
29 Nov, 2025 1 commit
- [ROCm][Bugfix] Patch for the `Multi-Modal Processor Test` group (#29702) · ea3370b4
  Andreas Karatzas authored Nov 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ea3370b4
28 Nov, 2025 4 commits
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
- Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) · f8151b66
  HappyAmazonian authored Nov 28, 2025
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f8151b66
- Revert "[CPU]Update CPU PyTorch to 2.9.0 (#29589)" (#29647) · b34e8775
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b34e8775
- [CPU]Update CPU PyTorch to 2.9.0 (#29589) · 35657bcd
  scydas authored Nov 28, 2025
```
Signed-off-by: scyda <scyda@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  35657bcd
27 Nov, 2025 2 commits
- [BugFix] Fix `plan` API Mismatch when using latest FlashInfer (#29426) · a5345bf4
  Andrii Skliar authored Nov 27, 2025
```
Signed-off-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
Co-authored-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
```
  a5345bf4
- Update Transformers pin in CI to 4.57.3 (#29418) · e1f26233
  Harry Mellor authored Nov 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e1f26233
26 Nov, 2025 1 commit
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
25 Nov, 2025 3 commits
- [CI/Build] Pin torchgeo dependency for AMD (#29353) · fe3a4f5b
  Ryan Rock authored Nov 25, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  fe3a4f5b
- [CI][ROCm] Install arctic-inference on ROCm tests (#29344) · 22b42b54
  Divakar Verma authored Nov 24, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  22b42b54
- [XPU] upgrade torch & ipex 2.9 on XPU platform (#29307) · b8328b49
  Kunshang Ji authored Nov 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b8328b49
24 Nov, 2025 2 commits
- [NIXL] Use config to enable telemetry + NIXL version bump (#29305) · 26a46558
  Nicolò Lucchesi authored Nov 24, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  26a46558
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
23 Nov, 2025 1 commit
- [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) · 55c21c88
  Micah Williamson authored Nov 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  55c21c88
22 Nov, 2025 1 commit
- [CI/Build] Add terratorch for AMD (#29205) · ed8e6843
  Ryan Rock authored Nov 21, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ed8e6843
21 Nov, 2025 1 commit
- Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) · 2b1b3dfa
  Bhagyashri authored Nov 21, 2025
```
Signed-off-by: Bhagyashri <Bhagyashri.Gaikwad2@ibm.com>
```
  2b1b3dfa
20 Nov, 2025 2 commits
- [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) · 82b05b15
  TJian authored Nov 20, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  82b05b15
- [Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221) · 66483a9d
  cjackal authored Nov 20, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  66483a9d
19 Nov, 2025 2 commits

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c

[CPU] Refactor CPU WNA16 (#28826) · 20852c8f
Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
20852c8f

18 Nov, 2025 2 commits

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

Run macos smoke test workflow on main commit (#28752) · 88ab591f
Michael Goin authored Nov 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
88ab591f

14 Nov, 2025 4 commits

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0aecd913
[ROCm] Bump up the version of amd-smi to 6.4.3 (#28680) · 2aa75c75
Sage Moore authored Nov 13, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
2aa75c75

13 Nov, 2025 4 commits
- [Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791) · faed7bf0
  Kebe authored Nov 14, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  faed7bf0
- Use official xformers-0.0.33 built for PT 2.9 (#28600) · c33b87e7
  Huy Do authored Nov 12, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c33b87e7
- 修改triton 量化w8a8 config命令方式 · 9f7f976c
  zhuwenwen authored Nov 13, 2025
```
add deps of pd-pp
```
  9f7f976c
- [ROCm][Bugfix] Revert removing setuptools version restriction (#28592) · d75ad048
  Gregory Shtrasberg authored Nov 12, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d75ad048
11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

09 Nov, 2025 1 commit
- fix: close issue 28338 by fixed python version (#28339) · 3a7d5803
  yihong authored Nov 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  3a7d5803
08 Nov, 2025 3 commits
- Remove setuptools upper bound constraint (<80) (#28337) · 32787d06
  Cole Murray authored Nov 08, 2025
```
Signed-off-by: Cole Murray <colemurray.cs@gmail.com>
```
  32787d06
- Bump arctic-inference requirement (#28174) · 781f5ebf
  Aurick Qiao authored Nov 07, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  781f5ebf
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
06 Nov, 2025 1 commit
- [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) · 5e0c1fe6
  Andy Lo authored Nov 06, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  5e0c1fe6
05 Nov, 2025 1 commit
- [Hardware][IBM Z] Optimize s390x Dockerfile (#28023) · e0449244
  R3hankhan authored Nov 06, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  e0449244
04 Nov, 2025 1 commit
- [CI/Build] Update LM Eval Version in AMD CI (#27944) · 2f84ae1f
  Zhewen Li authored Nov 03, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  2f84ae1f
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967