Commits · de527e1cec820686f2bead759e4e99a20b172589 · OpenDAS / vllm_cscc

26 Feb, 2026 3 commits
- [UX] Add `--moe-backend` arg for explicit kernel selection (#33807) · de527e1c
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  de527e1c
- [UX] Add `--performance-mode {balanced,interactivity,throughput}` (#34936) · cbf8f702
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cbf8f702
- [offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c
  Ming Yang authored Feb 25, 2026
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6831650c
24 Feb, 2026 1 commit
- [CPU][Perf] Accelerate Attention head for s390x using vector intrinsics (#34434) · 34ce0ffd
  R3hankhan authored Feb 24, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  34ce0ffd
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
18 Feb, 2026 1 commit
- [Attention] Refactor `check_and_update_config` (#33600) · 77431529
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77431529
16 Feb, 2026 1 commit

[CI] Enable mypy coverage for individual excluded files (#34292) · a3205bef

Lucas Kabela authored Feb 16, 2026


Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a3205bef

14 Feb, 2026 1 commit
- [Feature][Perf] Support Selective CPU Weight Offloading (#34535) · b37b6797
  Wei Zhao authored Feb 13, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b37b6797
12 Feb, 2026 1 commit
- [V0 Deprecation] Remove code related to per-request logits processors (#34400) · fb455ed5
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fb455ed5
10 Feb, 2026 1 commit
- [Feature] Warn about unrecognized environment variables (#33581) · f0ca0671
  Gregory Shtrasberg authored Feb 10, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f0ca0671
09 Feb, 2026 1 commit
- [UX] Add `--language-model-only` for hybrid models (#34120) · 64a9c252
  Roger Wang authored Feb 09, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  64a9c252
07 Feb, 2026 1 commit

[Kernel] Add KernelConfig flag to enable/disable FlashInfer autotune (#34006) · dd6a6e11

Mohammad Miadh Angkad authored Feb 07, 2026

Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

dd6a6e11

06 Feb, 2026 1 commit
- Update `WeightTransferConfig` to be more standard like the others (#33989) · 51a7bda6
  Harry Mellor authored Feb 06, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51a7bda6
05 Feb, 2026 1 commit

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

02 Feb, 2026 1 commit

Reduce the kernel overhead when num of active loras is smaller than max... · ffe1fc7a

yugong333 authored Feb 02, 2026


  Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)
Signed-off-by: Yu Gong <yu3.gong@gmail.com>

ffe1fc7a

30 Jan, 2026 1 commit
- Move decode context parallel validationn to `ParallelConfig` (#33239) · d334dd26
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d334dd26
27 Jan, 2026 1 commit
- [Bugfix] Fix display error (inconsistent with context) (#33020) · f5d7049c
  linhaifeng authored Jan 28, 2026
```
Signed-off-by: linhaifeng <1371675203@qq.com>
```
  f5d7049c
23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

20 Jan, 2026 1 commit
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
15 Jan, 2026 1 commit
- [UX] Use kv_offloading_backend=native by default (#32421) · 1be5a735
  Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1be5a735
14 Jan, 2026 1 commit
- Consolidate Intel Quantization Toolkit Integration in vLLM (#31716) · 50632adc
  Yi Liu authored Jan 14, 2026
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  50632adc
13 Jan, 2026 1 commit
- [Misc] Allow enabling NCCL for DP sync when async scheduling (#32197) · 9273a427
  Nick Hill authored Jan 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9273a427
12 Jan, 2026 1 commit

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

09 Jan, 2026 3 commits

[1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2612ba92

[Feature] Add iteration level logging and enhance nvtx marker (#31193) · 6ebe34d6

Max Hu authored Jan 08, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

6ebe34d6

[Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1

Robert Shaw authored Jan 08, 2026

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5825bbc1

08 Jan, 2026 2 commits

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) · 04a49669

omer-dayan authored Jan 08, 2026


Signed-off-by: Omer Dayan <omdayan@nvidia.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

04a49669

[Fix] Enable mm_processor_cache with vision LoRA (#31927) · d3235cb5
prashanth058 authored Jan 08, 2026
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
d3235cb5

06 Jan, 2026 1 commit
- [UX] Add `-ep` shorthand for `--enable-expert-parallel` (#30890) · a68e703c
  Michael Goin authored Jan 05, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a68e703c
02 Jan, 2026 2 commits
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
- Add Multimodal Processor Benchmark (#29105) · 1f5b7c41
  Reagan Lee authored Jan 01, 2026
```
Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  1f5b7c41
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 2 commits
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf
- Add `--max-model-len auto` to auto-fit context to available memory (#29431) · 8ee90c83
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8ee90c83
18 Dec, 2025 2 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9

SungMinCho authored Dec 17, 2025


Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

a0b782f9

17 Dec, 2025 1 commit
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785) · 7b966ae2
  danielafrimi authored Dec 17, 2025
```
Signed-off-by: <>
Co-authored-by: root <root@gpu-937.slurm-workers-slurm.slurm.svc.cluster.local>
```
  7b966ae2
16 Dec, 2025 1 commit

[feature] extend DBO to XBO (#30120) · b9ff4f2a

jiangkuaixue123 authored Dec 16, 2025


Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>

b9ff4f2a

15 Dec, 2025 1 commit

[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator +... · 185c22bf

Nicolò Lucchesi authored Dec 15, 2025


[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805)
Signed-off-by: NickLucche <nlucches@redhat.com>

185c22bf