Commits · 7b01d97a22c977aaad2f38fa03cd11742d2893e8 · OpenDAS / vllm_cscc

25 Mar, 2026 1 commit
- [CPU][UX][Perf] Enable tcmalloc by default (#37607) · 34d317dc
  Fadi Arafeh authored Mar 25, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  34d317dc
19 Mar, 2026 1 commit
- [Bugfix] Avoid more OpenMP thread reallocation in CPU torch compile (#37538) · 3322e264
  Li, Jiang authored Mar 19, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  3322e264
18 Mar, 2026 1 commit
- [Bugfix] Avoid OpenMP thread reallocation in CPU torch compile (#37391) · 26180124
  Li, Jiang authored Mar 18, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  26180124
14 Mar, 2026 1 commit

[UX] Improve UX of CPU backend (#36968) · 092ace9e

Li, Jiang authored Mar 14, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

092ace9e

11 Mar, 2026 1 commit
- feat: add RISC-V support for CPU backend (v2) (#36578) · 41846537
  typer-J authored Mar 11, 2026
```
Signed-off-by: typer-J <2236066784@qq.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  41846537
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
28 Feb, 2026 1 commit
- [CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
  Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
  90805ff4
12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

11 Feb, 2026 1 commit
- [XPU][9/N] clean up existing ipex code/doc (#34111) · cb9574eb
  Kunshang Ji authored Feb 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  cb9574eb
09 Feb, 2026 1 commit

Add NUMA Core binding in nixl_connector for CPU xPyD (#32365) · cb62e86f

ZhengHongming888 authored Feb 09, 2026

Signed-off-by: Hongming Zheng <hongming.zheng@intel.com>
Signed-off-by: ZhengHongming888 <hongming.zheng@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

cb62e86f

22 Jan, 2026 1 commit
- [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795) · 955b43a5
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  955b43a5
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
07 Jan, 2026 1 commit
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
31 Dec, 2025 1 commit

[BugFix] Fix NUMA node validation in CPU platform (#31520) · 70e1acef

SameerAsal authored Dec 30, 2025


Signed-off-by: SameerAsal <SameerAsal@users.noreply.github.com>
Co-authored-by: SameerAsal <SameerAsal@users.noreply.github.com>

70e1acef

30 Dec, 2025 1 commit
- [CPU] Disable async schedule on CPU (#31525) · 71575961
  Li, Jiang authored Dec 30, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  71575961
15 Dec, 2025 1 commit

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

12 Dec, 2025 1 commit
- [CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) · f355ad54
  Fadi Arafeh authored Dec 12, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  f355ad54
07 Dec, 2025 1 commit
- [v1] Add PrefixLM support to FlexAttention backend (#27938) · b952f4d3
  Isotr0py authored Dec 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b952f4d3
04 Dec, 2025 1 commit
- [Bugfix][CPU] Fix CPU KV cache fallback memory allocation (#29604) · 28097d56
  gausah01 authored Dec 04, 2025
```
Signed-off-by: Gauri Sahnan <gauri.sahnan@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  28097d56
28 Nov, 2025 1 commit
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
15 Nov, 2025 1 commit
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
14 Nov, 2025 2 commits
- [Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2741f6c
- [Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  511a6b61
13 Nov, 2025 1 commit
- [CI Failure] Fix backend selection for encoder-only models (#28534) · 07a606aa
  Huamin Li authored Nov 13, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  07a606aa
12 Nov, 2025 2 commits
- [V0 deprecation] Deprecate use_v1 parameter (#28112) · 10138c92
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  10138c92
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

06 Nov, 2025 2 commits
- [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) · e52e4da9
  StanHatko authored Nov 06, 2025
```
Signed-off-by: Stan Hatko <stan_hatko@live.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e52e4da9
- [Bug] Fix cpu disable shared_experts `VLLM_DISABLE_SHARED_EXPERTS_STREAM` (#28157) · d79d9f07
  Wentao Ye authored Nov 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d79d9f07
31 Oct, 2025 1 commit
- [Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734) · 36960501
  Akash kaothalkar authored Oct 31, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  36960501
27 Oct, 2025 1 commit
- [cpu][perf] Fix low CPU utilization with VLLM_CPU_OMP_THREADS_BIND on AArch64 (#27415) · a663f6ae
  Fadi Arafeh authored Oct 27, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  a663f6ae
22 Oct, 2025 1 commit
- [Bugfix][CPU] Disable dual stream execution for experts on CPU (#27320) · 843af7f7
  Li, Jiang authored Oct 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  843af7f7
18 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

13 Oct, 2025 1 commit

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [CPU] fix the issue when the node is '-' cause json decode error. (#26562) · f7ee6986
  muzian666 authored Oct 11, 2025
```
Signed-off-by: muzian666 <andylee_2001@163.com>
Co-authored-by: qingan.li <qingan.li@wizpresso.com>
```
  f7ee6986
09 Oct, 2025 1 commit

Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11

Jiangyun Zhu authored Oct 09, 2025


Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>

5728da11

07 Oct, 2025 1 commit

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4

Morrison Turnansky authored Oct 07, 2025


[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

0c824fc4