Commits · f6aa122698790fb1a544e8d80ba97c49f02be945 · OpenDAS / vllm_cscc

18 Nov, 2025 5 commits
- [CI Sprint] Quantization CI Cleanup (#24130) · f6aa1226
  Alex authored Nov 18, 2025
```
Signed-off-by: Alex Yun <alexyun04@gmail.com>
```
  f6aa1226
- [CI/Build] Replace wikipedia url with local server ones (#28908) · 896e41ae
  Isotr0py authored Nov 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  896e41ae
- [CI] Fix async scheduling + spec decoding test flake (#28902) · 5bdd1552
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bdd1552
- [Bugfix] Fix wrong CLI defaults for dynamic `SchedulerConfig` fields (#28872) · bf9e1e87
  Cyrus Leung authored Nov 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf9e1e87
- [Bugfix] Fix Kimi-K2 tool parser concatenated tool calls parsing (#28831) · b6e04390
  Benjamin Bartels authored Nov 18, 2025
```
Signed-off-by: Thomas Mao <yiyeguhu@gmail.com>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Thomas Mao <yiyeguhu@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  b6e04390
17 Nov, 2025 6 commits
- [Model] Add Afmoe architecture implementation (#28332) · f77bce00
  Pranav authored Nov 17, 2025
```
Signed-off-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
Signed-off-by: Pranav <veldurthipranav@gmail.com>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
```
  f77bce00
- [Test] Batch Invariant: Rename and organize tests (#27421) · a289cc1d
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a289cc1d
- [Quantization] [Eagle] Add complete quantization support to the draft model in Eagle (#28435) · 95ae50b7
  Shreyas Kulkarni authored Nov 17, 2025
```
Signed-off-by: Shreyas Kulkarni <shreyas.gp269@gmail.com>
```
  95ae50b7
- [Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61
  Ronald authored Nov 18, 2025
```
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  d8874c61
- [Bugfix][Perf] Revert applying HF processor on text-only inputs for multimodal models (#28858) · 7f064491
  Roger Wang authored Nov 17, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  7f064491
- [Bugfix][Model] Prevent special token leakage in KimiK2ToolParser streaming mode (#28543) · 6f374192
  Jay Caldwell authored Nov 16, 2025
```
Signed-off-by: Jscaldwell55 <jay.s.caldwell@gmail.com>
```
  6f374192
16 Nov, 2025 4 commits

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787) · 80b6080d
Nick Hill authored Nov 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
80b6080d
Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261) · 03ee4811
amirkl94 authored Nov 16, 2025

03ee4811

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

[Model] Allow users to control skip reading cache per request. (#28194) · a55b6463
wang.yuqi authored Nov 16, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
a55b6463

15 Nov, 2025 9 commits

Add support for Eagle with separate lm-head and embed_tokens layers (#28549) · e439c784
Eldar Kurtić authored Nov 15, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
e439c784

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

[Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
638e4196

[Redo] #26368 (#28771) · 98b4d389

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

[Performance][DeepGEMM] Estimate expected_m (#28694) · 6965ef43

Varun Sundar Rabindranath authored Nov 15, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

6965ef43

[NIXL] heterogeneous block_size support (#26759) · c9e66585

Chendi.Xue authored Nov 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

c9e66585

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

[Test] Rework e2e async scheduling tests (#28744) · 58e61e56
Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
58e61e56

14 Nov, 2025 16 commits

Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
2e0ad629
[Bugfix] TypeError: 'NoneType' object is not callable (#27410) · 0de4f217
Marcin Ostrowski authored Nov 14, 2025
```
Signed-off-by: Marcin Ostrowski <marcinx.ostrowski@intel.com>
```
0de4f217
[Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e2741f6c
[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716) · a425dc25
TJian authored Nov 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
a425dc25

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f3cd7f7

[Fix] improve aspect ratio in dummy image generation and add common VLM tests... · c934caee

dongbo910220 authored Nov 15, 2025


[Fix] improve aspect ratio in dummy image generation and add common  VLM tests for PaddleOCR-VL (#28711)
Signed-off-by: dongbo910220 <1275604947@qq.com>

c934caee

[Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
511a6b61
[Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
96b23b8e
[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
Lucas Wilkinson authored Nov 14, 2025

db56a599
Fix KV sharing fast prefill with cudagraph enabled (#28537) · 9324e102
Yong Hoon Shin authored Nov 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
9324e102

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

[Misc] fix comment in test_envs (#28529) · 8cfbe89b
Xing Liu authored Nov 14, 2025
```
Signed-off-by: Xing Liu <xingliu14@gmail.com>
```
8cfbe89b
[Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
fd75d3e8
Add output token counting to gsm8k eval (#28594) · c9a3a021
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
c9a3a021