Commits · 5708297e4e7f27c4d06d6e4f62d75c3d2d1fc674 · OpenDAS / vllm_cscc

05 Jan, 2026 6 commits
- [Misc][Model][Refactor] Pass the prefix into Linear layers (#31669) · 5708297e
  Wang Kunpeng authored Jan 06, 2026
```
Signed-off-by: Wang Kunpeng <1289706727@qq.com>
```
  5708297e
- [Bugfix][CPU] Fix RotaryEmbedding fallback causing gibberish with --enforce-eager (#31643) · c455b771
  RickyChen / 陳昭儒 authored Jan 06, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  c455b771
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
- [Model] Enable LoRA support for BLIP2 (#31620) · a2ad15c0
  Qiping Pan authored Jan 05, 2026
```
Signed-off-by: Qiping Pan <panqiping@outlook.com>
```
  a2ad15c0
- [CI Failure] Fix NomicBert max_model_len validation (#31662) · 8be6432b
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8be6432b
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
03 Jan, 2026 2 commits

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533) · 268b1c55

Robert Shaw authored Jan 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

268b1c55

Improve HF qwen3_omni: preserve audio_sample_rate in kwargs restructuring (#29255) · 97a01308
jeremyteboul authored Jan 02, 2026
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
97a01308

02 Jan, 2026 9 commits
- [MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504) · a3f2f409
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a3f2f409
- [MoE Refactor] Split `invoke_fused_moe_kernel` (#31050) · 5a468ff7
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5a468ff7
- [MoE] Fix output_shape calculation in Attention layer to handle 3D query inputs (#31596) · 6ef770df
  Andreas Karatzas authored Jan 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ef770df
- [Bugfix] Fix weight_loader v1 block scale (#31103) · cc410e86
  Kyuyeun Kim authored Jan 01, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  cc410e86
- Remove unused `use_marlin` variable in `Mxfp4MoEMethod` (#31549) · 1f43c121
  Vaibhav Sourirajan authored Jan 02, 2026
```
Signed-off-by: vaibhav sourirajan <vs2787@columbia.edu>
```
  1f43c121
- [Bugfix] Fix activation quantization for compressed-tensors W4A16 (#31572) · ca179d0f
  Tmn07 authored Jan 02, 2026
```
Signed-off-by: Tmn07 <tmn0796@gmail.com>
```
  ca179d0f
- [Model] Enable LoRA support for tower and connector in LLaVA (#31513) · 5ac55eb3
  Jay Hemnani authored Jan 01, 2026
```
Signed-off-by: Jay Hemnani <jayhemnani9910@gmail.com>
Co-authored-by: Jay Hemnani <jayhemnani9910@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  5ac55eb3
- feat: support LoRA for DeepSeek-OCR(Language Model part) (#31569) · 27864a85
  zhima771 authored Jan 02, 2026
```
Signed-off-by: zhima771 <15836938703@163.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  27864a85
- [Bugfix] Replace BaseException with specific exceptions in FLA utils (#31590) · 5fff4406
  Kevin McKay authored Jan 01, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  5fff4406
31 Dec, 2025 4 commits

[Bugfix] Fix BAGEL online serving for text and image understanding (#31546) · d8da76f3

Fanjiang Ye authored Dec 31, 2025


Signed-off-by: Dylan1229 <yvanphys@gmail.com>
Signed-off-by: UED <zxr3611244710@gmail.com>
Signed-off-by: mr-ye-cao <yecaoyc2019@gmail.com>
Co-authored-by: UED <zxr3611244710@gmail.com>
Co-authored-by: mr-ye-cao <yecaoyc2019@gmail.com>
Co-authored-by: Mr-Ye-Cao <60802056+Mr-Ye-Cao@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d8da76f3

Add GLM-ASR multimodal support (#31436) · d722e9e6

baonudesifeizhai authored Dec 31, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

d722e9e6

Add get_expert_mapping to NemotronHModel (for LoRA support) (#31539) · 108a2728
danisereb authored Dec 31, 2025
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
108a2728
[Mics] add pcp basic support to MoE model (#31003) · 84f6cd74
Qiu authored Dec 31, 2025

84f6cd74

30 Dec, 2025 2 commits

[BugFix] add select_gemm_impl on CompressedTensorsWNA16MoEMethod to support LoRA (#31453) · 07728bf5
JartX authored Dec 30, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
07728bf5

[Model] Add support for openPangu moe model (#28775) · 3f52fa5a

yt0428 authored Dec 31, 2025


Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3f52fa5a

29 Dec, 2025 4 commits
- [Bugfix][ROCm] Fix Static Quant Issue (#31502) · 56f51625
  Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  56f51625
- [MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499) · 9152a30d
  Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9152a30d
- Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
  Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  5bc66411
- Replace `nn.ConvNd` with vLLM's `ConvNdLayer` for Transformers modeling backend (#31498) · e37e7349
  Harry Mellor authored Dec 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e37e7349
28 Dec, 2025 2 commits
- Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) · b9793e6a
  Mamy Ratsimbazafy authored Dec 28, 2025
```
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
```
  b9793e6a
- [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) · 0b6b7010
  Jzz1943 authored Dec 29, 2025
```
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
```
  0b6b7010
27 Dec, 2025 1 commit
- [MoE Refactor][10/N] Cleanup Fp8 Process Weights After Loading (#31169) · 727c41f3
  Robert Shaw authored Dec 27, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  727c41f3
26 Dec, 2025 5 commits

CustomOp: Unify aiter impl into GroupedTopk (#31221) · 87f1b8ca
Xinyu Chen authored Dec 27, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
87f1b8ca

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

[Misc] Fix Qwen2-MoE shared_expert_gate (#31339) · c3666f56
Jee Jee Li authored Dec 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
c3666f56
Support LoRA and GPTQModel for PLaMo 2/3 (#31322) · 9ee05cbe
Shinichi Hemmi authored Dec 26, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
9ee05cbe

Feature/isaac 0.1 (#28367) · b7165d53

oscardev256 authored Dec 25, 2025


Signed-off-by: oscardev256 <42308241+oscardev256@users.noreply.github.com>
Signed-off-by: Oscar Gonzalez <ogonzal6@alumni.jh.edu>
Signed-off-by: Yang <lymailforjob@gmail.com>
Co-authored-by: Yang <lymailforjob@gmail.com>

b7165d53

25 Dec, 2025 1 commit
- [Model][Ernie4.5-VL] Support video metadata for timestamp rendering (#31274) · 2d6001f4
  SongHe authored Dec 25, 2025
```
Signed-off-by: dengsonghe <dengsonghe@baidu.com>
Co-authored-by: dengsonghe <dengsonghe@baidu.com>
```
  2d6001f4
24 Dec, 2025 4 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Bugfix] Remove dead `block_quant_to_tensor_quant` function (#31294) · 506eb0f4
  ゆり authored Dec 25, 2025
```
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  506eb0f4
- [Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179) · 66c98874
  Kevin McKay authored Dec 24, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  66c98874
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec