Commits · 78d13ea9de4b1ce5e4d8a5af9738fea71fb024e5 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "6774bd50b0c19b3f33717d15763022df385a1b70"

12 Jan, 2026 3 commits

Add K-EXAONE-236B-A23B (#31621) · 63ed2409

Kyungmin Lee authored Jan 13, 2026


Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: lgai-exaone <exaonemodels@lgresearch.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

63ed2409

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) · 9cddbdba
Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
9cddbdba

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 2 commits
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
- [Misc][LLaMa4] Compile LLaMa Vision Encoder (#30709) · ea6d067a
  Lucas Kabela authored Jan 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ea6d067a
09 Jan, 2026 7 commits
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
- [Misc] Enable async scheduling by default with spec decoding (#31998) · 3adffd5b
  Nick Hill authored Jan 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  3adffd5b
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Doc] Add developer guide for CustomOp (#30886) · 08d954f0
  Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  08d954f0
- [Model] Reorganize pooling layers (#31973) · c8ed39b9
  Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c8ed39b9
- [Feature] Add iteration level logging and enhance nvtx marker (#31193) · 6ebe34d6
  Max Hu authored Jan 08, 2026
```
Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
```
  6ebe34d6
- [Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1
  Robert Shaw authored Jan 08, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5825bbc1
08 Jan, 2026 5 commits

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

[Chore] Further cleanup pooler (#31951) · d1b6fe00
Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d1b6fe00

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) · 04a49669

omer-dayan authored Jan 08, 2026


Signed-off-by: Omer Dayan <omdayan@nvidia.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

04a49669

[Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) · e5173d3b
Andy Liu authored Jan 07, 2026

e5173d3b

07 Jan, 2026 4 commits
- [EPLB] Optimize EPLB with numpy (#29499) · 6170d47d
  Ilya Markov authored Jan 07, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  6170d47d
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Misc] Improve error messages for unsupported types and parameters (#30593) · 0790f076
  BlankR authored Jan 07, 2026
```
Signed-off-by: BlankR <hjyblanche@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  0790f076
- Change warning in get_current_vllm_config to report caller's line number (#31855) · f09c5feb
  Tyler Michael Smith authored Jan 06, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f09c5feb
06 Jan, 2026 3 commits

[Quantization][Refactor] Move CPU GPTQ kernel into MP linear (#31801) · 8becf146

Li, Jiang authored Jan 07, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8becf146

[Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
96860af6

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

05 Jan, 2026 2 commits
- [Misc] Enable Paligemma's PrefixLM attention mask computation (#31725) · 51e38a8e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  51e38a8e
- [CI Failure] Fix NomicBert max_model_len validation (#31662) · 8be6432b
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8be6432b
02 Jan, 2026 3 commits
- [Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454) · 0eee877f
  Xingyu Liu authored Jan 02, 2026
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
```
  0eee877f
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
- Add Multimodal Processor Benchmark (#29105) · 1f5b7c41
  Reagan Lee authored Jan 01, 2026
```
Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  1f5b7c41
30 Dec, 2025 1 commit
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
29 Dec, 2025 1 commit
- [Core] Enable async scheduling by default (#27614) · c2ff33cc
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c2ff33cc
27 Dec, 2025 1 commit
- [BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  2f12cd32
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 4 commits
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf
- [Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131) · bd89ce16
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd89ce16
- [CI/Build] Ignore data_parallel_size_local (#30281) · ddfac703
  Ryan Rock authored Dec 24, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ddfac703
- Add `--max-model-len auto` to auto-fit context to available memory (#29431) · 8ee90c83
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8ee90c83
23 Dec, 2025 2 commits
- Use helper function instead of looping through attribute names (#29788) · c016c95b
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c016c95b
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee