Commits · fc1d8be3dc97e33ade7fb578451006bb044a5e60 · OpenDAS / vllm_cscc

26 Nov, 2025 1 commit
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
25 Nov, 2025 3 commits
- [CI/Build] Pin torchgeo dependency for AMD (#29353) · fe3a4f5b
  Ryan Rock authored Nov 25, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  fe3a4f5b
- [CI][ROCm] Install arctic-inference on ROCm tests (#29344) · 22b42b54
  Divakar Verma authored Nov 24, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  22b42b54
- [XPU] upgrade torch & ipex 2.9 on XPU platform (#29307) · b8328b49
  Kunshang Ji authored Nov 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b8328b49
24 Nov, 2025 2 commits
- [NIXL] Use config to enable telemetry + NIXL version bump (#29305) · 26a46558
  Nicolò Lucchesi authored Nov 24, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  26a46558
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
23 Nov, 2025 1 commit
- [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) · 55c21c88
  Micah Williamson authored Nov 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  55c21c88
22 Nov, 2025 1 commit
- [CI/Build] Add terratorch for AMD (#29205) · ed8e6843
  Ryan Rock authored Nov 21, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ed8e6843
21 Nov, 2025 1 commit
- Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) · 2b1b3dfa
  Bhagyashri authored Nov 21, 2025
```
Signed-off-by: Bhagyashri <Bhagyashri.Gaikwad2@ibm.com>
```
  2b1b3dfa
20 Nov, 2025 2 commits
- [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) · 82b05b15
  TJian authored Nov 20, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  82b05b15
- [Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221) · 66483a9d
  cjackal authored Nov 20, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  66483a9d
19 Nov, 2025 2 commits

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c

[CPU] Refactor CPU WNA16 (#28826) · 20852c8f
Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
20852c8f

18 Nov, 2025 2 commits

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

Run macos smoke test workflow on main commit (#28752) · 88ab591f
Michael Goin authored Nov 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
88ab591f

14 Nov, 2025 4 commits

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0aecd913
[ROCm] Bump up the version of amd-smi to 6.4.3 (#28680) · 2aa75c75
Sage Moore authored Nov 13, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
2aa75c75

13 Nov, 2025 3 commits
- [Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791) · faed7bf0
  Kebe authored Nov 14, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  faed7bf0
- Use official xformers-0.0.33 built for PT 2.9 (#28600) · c33b87e7
  Huy Do authored Nov 12, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c33b87e7
- [ROCm][Bugfix] Revert removing setuptools version restriction (#28592) · d75ad048
  Gregory Shtrasberg authored Nov 12, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d75ad048
11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

09 Nov, 2025 1 commit
- fix: close issue 28338 by fixed python version (#28339) · 3a7d5803
  yihong authored Nov 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  3a7d5803
08 Nov, 2025 3 commits
- Remove setuptools upper bound constraint (<80) (#28337) · 32787d06
  Cole Murray authored Nov 08, 2025
```
Signed-off-by: Cole Murray <colemurray.cs@gmail.com>
```
  32787d06
- Bump arctic-inference requirement (#28174) · 781f5ebf
  Aurick Qiao authored Nov 07, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  781f5ebf
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
06 Nov, 2025 1 commit
- [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) · 5e0c1fe6
  Andy Lo authored Nov 06, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  5e0c1fe6
05 Nov, 2025 1 commit
- [Hardware][IBM Z] Optimize s390x Dockerfile (#28023) · e0449244
  R3hankhan authored Nov 06, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  e0449244
04 Nov, 2025 1 commit
- [CI/Build] Update LM Eval Version in AMD CI (#27944) · 2f84ae1f
  Zhewen Li authored Nov 03, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  2f84ae1f
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
01 Nov, 2025 2 commits

[Docs] Mock all imports for docs (#27873) · 799ce45c
Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
799ce45c

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

30 Oct, 2025 3 commits
- Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) · ba33e883
  Huy Do authored Oct 30, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  ba33e883
- [Feat] Adds runai distributed streamer (#27230) · 17d055f5
  Benjamin Bartels authored Oct 30, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17d055f5
- [XPU] Update latest IPEX 2.8 release (#27735) · b5bae42f
  Kunshang Ji authored Oct 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b5bae42f
29 Oct, 2025 3 commits
- [Build] Revert triton_kernels requirements (#27659) · f6d5f588
  Varun Sundar Rabindranath authored Oct 29, 2025
  
  f6d5f588
- Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) · 9007bf57
  Simon Mo authored Oct 28, 2025
  
  9007bf57
- Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) · f2575447
  Huy Do authored Oct 28, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f2575447
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb