Commits · ac9f9330e662261242f31f4e0efc9cb9603e4eae · OpenDAS / vllm_cscc

09 Jan, 2026 3 commits

[Model] Reorganize pooling layers (#31973) · c8ed39b9
Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c8ed39b9

[Feature] Add iteration level logging and enhance nvtx marker (#31193) · 6ebe34d6

Max Hu authored Jan 08, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

6ebe34d6

[Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1

Robert Shaw authored Jan 08, 2026

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5825bbc1

08 Jan, 2026 5 commits

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

[Chore] Further cleanup pooler (#31951) · d1b6fe00
Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d1b6fe00

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) · 04a49669

omer-dayan authored Jan 08, 2026


Signed-off-by: Omer Dayan <omdayan@nvidia.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

04a49669

[Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) · e5173d3b
Andy Liu authored Jan 07, 2026

e5173d3b

07 Jan, 2026 4 commits
- [EPLB] Optimize EPLB with numpy (#29499) · 6170d47d
  Ilya Markov authored Jan 07, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  6170d47d
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Misc] Improve error messages for unsupported types and parameters (#30593) · 0790f076
  BlankR authored Jan 07, 2026
```
Signed-off-by: BlankR <hjyblanche@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  0790f076
- Change warning in get_current_vllm_config to report caller's line number (#31855) · f09c5feb
  Tyler Michael Smith authored Jan 06, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f09c5feb
06 Jan, 2026 3 commits

[Quantization][Refactor] Move CPU GPTQ kernel into MP linear (#31801) · 8becf146

Li, Jiang authored Jan 07, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8becf146

[Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
96860af6

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

05 Jan, 2026 2 commits
- [Misc] Enable Paligemma's PrefixLM attention mask computation (#31725) · 51e38a8e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  51e38a8e
- [CI Failure] Fix NomicBert max_model_len validation (#31662) · 8be6432b
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8be6432b
02 Jan, 2026 3 commits
- [Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454) · 0eee877f
  Xingyu Liu authored Jan 02, 2026
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
```
  0eee877f
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
- Add Multimodal Processor Benchmark (#29105) · 1f5b7c41
  Reagan Lee authored Jan 01, 2026
```
Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>
```
  1f5b7c41
30 Dec, 2025 1 commit
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
29 Dec, 2025 1 commit
- [Core] Enable async scheduling by default (#27614) · c2ff33cc
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c2ff33cc
27 Dec, 2025 1 commit
- [BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  2f12cd32
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 4 commits
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf
- [Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131) · bd89ce16
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd89ce16
- [CI/Build] Ignore data_parallel_size_local (#30281) · ddfac703
  Ryan Rock authored Dec 24, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ddfac703
- Add `--max-model-len auto` to auto-fit context to available memory (#29431) · 8ee90c83
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8ee90c83
23 Dec, 2025 3 commits
- Use helper function instead of looping through attribute names (#29788) · c016c95b
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c016c95b
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
- Add util function for checking nesting of rope parameters (#31146) · b10d47e0
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b10d47e0
22 Dec, 2025 2 commits
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
19 Dec, 2025 1 commit

[Model] Add MiMo-V2-Flash support (#30836) · 969bbc7c

Zhonghua Deng authored Dec 20, 2025


Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: Jumiar <liuanqim10@126.com>
Signed-off-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jumiar <liuanqim10@126.com>
Co-authored-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

969bbc7c

18 Dec, 2025 4 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7

Lucas Wilkinson authored Dec 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30bb19a7

[compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
5f2f3fba

[Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9

SungMinCho authored Dec 17, 2025


Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

a0b782f9

16 Dec, 2025 2 commits
- update piecewise cudagraph warning when splitting_ops=[] (#30728) · 104003dc
  Boyuan Feng authored Dec 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  104003dc
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a