Commits · 2dacd5739409847e91299e7747a142e200fdff6c · OpenDAS / vllm_cscc

13 Nov, 2025 1 commit
- [platform] Move get_cu_count to utils (#27005) · 2dacd573
  wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2dacd573
12 Nov, 2025 7 commits
- [Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  4ca5cd57
- [ROCM] Fix ROCm warnings, environment flag access, and GEMM kernel naming for... · d8140b98
  vllmellm authored Nov 13, 2025
```
[ROCM] Fix ROCm warnings, environment flag access, and GEMM kernel naming for consistency in `_aiter_ops.py` (#28464)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  d8140b98
- Fix pre-commit (and XPU) on `main` (#28556) · 54aecd9e
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  54aecd9e
- [V0 deprecation] Deprecate use_v1 parameter (#28112) · 10138c92
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  10138c92
- [XPU]Fix crash due to removed VLLM_USE_V1 attribute (#28520) · a4730c1b
  Chaojun Zhang authored Nov 12, 2025
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
```
  a4730c1b
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 3 commits
- [TPU] Rename path to tpu platform (#28452) · df4d3a44
  Kyuyeun Kim authored Nov 11, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  df4d3a44
- Prefer FlashAttention MLA as default over FlashMLA (#27363) · 684f2545
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  684f2545
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 1 commit

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

09 Nov, 2025 1 commit
- [ROCm][Platform] Add RX7900XTX device id in _ROCM_DEVICE_ID_NAME_MAP (#28279) · c5f685b3
  JartX authored Nov 10, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  c5f685b3
06 Nov, 2025 2 commits
- [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) · e52e4da9
  StanHatko authored Nov 06, 2025
```
Signed-off-by: Stan Hatko <stan_hatko@live.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e52e4da9
- [Bug] Fix cpu disable shared_experts `VLLM_DISABLE_SHARED_EXPERTS_STREAM` (#28157) · d79d9f07
  Wentao Ye authored Nov 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d79d9f07
05 Nov, 2025 1 commit
- [ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) · 6cae1e53
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
```
  6cae1e53
01 Nov, 2025 2 commits

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03

wangxiyuan authored Nov 01, 2025


Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

30a14b03

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

31 Oct, 2025 1 commit
- [Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734) · 36960501
  Akash kaothalkar authored Oct 31, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  36960501
29 Oct, 2025 3 commits
- [Bug] Raise error explicitly if using incompatible backend (#27424) · 5b044810
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5b044810
- [ROCm][Platform] Add MI308X device id in _ROCM_DEVICE_ID_NAME_MAP (#27623) · ded24e3e
  Xiake Sun authored Oct 29, 2025
```
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
```
  ded24e3e
- [CI/Build][Bugfix]Fix Quantized Models Test on AMD (#27712) · 83fd49b1
  Zhewen Li authored Oct 28, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  83fd49b1
27 Oct, 2025 3 commits
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- [cpu][perf] Fix low CPU utilization with VLLM_CPU_OMP_THREADS_BIND on AArch64 (#27415) · a663f6ae
  Fadi Arafeh authored Oct 27, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  a663f6ae
- [Bugfix] Limit the default value of `max_model_len` when it is not specified by users (#27556) · a3e8611d
  Shanshan Shen authored Oct 27, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  a3e8611d
26 Oct, 2025 2 commits

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl... · 65d2cf95

JartX authored Oct 26, 2025


[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl ROCm TORCH_SDPA (#27190)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

65d2cf95

24 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
22 Oct, 2025 4 commits
- [Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754
  Luciano Martins authored Oct 22, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  e05a6754
- [NIXL] use Host buffer to support TP_ratio > 1 for XPU (#27140) · 7c4767f1
  Chendi.Xue authored Oct 22, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  7c4767f1
- [Bugfix][CPU] Disable dual stream execution for experts on CPU (#27320) · 843af7f7
  Li, Jiang authored Oct 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  843af7f7
- [1/N][Platform] Cleanup useless function (#26982) · f6027b28
  wangxiyuan authored Oct 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  f6027b28
18 Oct, 2025 2 commits

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

17 Oct, 2025 3 commits
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
15 Oct, 2025 3 commits

[Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
8f4b313c
[Platform] allow platform to init dp group (#22243) · db1764e4
wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
db1764e4

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a