Commits · 66e674cdd549e89b341fb33405a2c02ec5f5ae8d · OpenDAS / vllm_cscc

05 Dec, 2025 1 commit

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

04 Dec, 2025 1 commit

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

03 Dec, 2025 1 commit
- [Frontend] supports deepseekv32 chat template (#29837) · b78772c4
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b78772c4
02 Dec, 2025 1 commit
- [Chore]: Reorganize gguf utils funtions under `transformers_utils` (#29891) · 63b1da76
  Isotr0py authored Dec 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  63b1da76
01 Dec, 2025 1 commit
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
30 Nov, 2025 2 commits
- [Misc]Remove redundant hidden_size property in ModelConfig (#29749) · 21c26279
  Xingyu Liu authored Dec 01, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  21c26279
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
28 Nov, 2025 2 commits
- [compile] Include `enable_sleep_mode` into caching factors. (#29696) · 6173682b
  Zhengxu Chen authored Nov 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  6173682b
- Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056
  wang.yuqi authored Nov 28, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f4b76056
27 Nov, 2025 3 commits

[BugFix] Optional tokenizer argument when loading GGUF models (#29582) · 0840abdd

Injae Ryou authored Nov 28, 2025

Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0840abdd

[Attention] Update attention imports (#29540) · fc1d8be3
Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
fc1d8be3

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

25 Nov, 2025 5 commits

[caching] Add enable_prompt_embeds and cpu_offload_gb to compile hashes. (#29435) · 0abc7948
Zhengxu Chen authored Nov 25, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
0abc7948

Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768

Harry Mellor authored Nov 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a1f26768

[Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137) · 794029f0

Injae Ryou authored Nov 25, 2025


Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

794029f0

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

[Bugfix] Make deprecated `--task embedding` consistent with `--runner… (#29312) · 87185c88
Maryam Tahhan authored Nov 25, 2025
```
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
```
87185c88

21 Nov, 2025 2 commits

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7219bcd

20 Nov, 2025 1 commit

[Bugfix] Revert custom attention mask for gemma3-mm (#28995) · 64192d56

Isotr0py authored Nov 20, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

64192d56

19 Nov, 2025 4 commits

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

[config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02

Tova Movshovitz authored Nov 19, 2025


Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

ba558c02

[CPU] Refactor CPU WNA16 (#28826) · 20852c8f
Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
20852c8f

18 Nov, 2025 1 commit

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

14 Nov, 2025 2 commits

[Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f3cd7f7

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

13 Nov, 2025 1 commit

Fix `get_num_experts` when config sets it explicitly to `None` (#28652) · b230286f

Harry Mellor authored Nov 13, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: bruceszchen <bruceszchen@tencent.com>

b230286f

12 Nov, 2025 2 commits
- [Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  4ca5cd57
- [Model] [Config] Correctly identify granite-4.0-micro as non-hybrid model (#28563) · 64d57c3b
  Thomas Parnell authored Nov 12, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  64d57c3b
11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

04 Nov, 2025 2 commits

Remove deprecated `--rope-scaling` and `--rope-theta` (#28006) · 2f1cc8ce
Harry Mellor authored Nov 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2f1cc8ce

[model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f

yt0428 authored Nov 05, 2025


Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

05cae69f

02 Nov, 2025 1 commit
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
30 Oct, 2025 3 commits
- [Feature] Batch invariant torch.compile (#27660) · e7acb200
  Paul Zhang authored Oct 30, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e7acb200
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784) · af826e08
  wangxiyuan authored Oct 30, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  af826e08
28 Oct, 2025 3 commits
- [Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658) · f5710ef0
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5710ef0
- [compile] Add enable_prompt_embeds to compile hash. (#27285) · 259504e1
  Zhengxu Chen authored Oct 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  259504e1
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95