Commits · ccb309a9640f90ca288ecea817fff7cc9474dbf5 · OpenDAS / vllm_cscc

06 Jan, 2026 1 commit
- [Bugfix] vLLM produces invalid UTF-8 tokens and “�” (#28874) · 2f4e6548
  John Calderon authored Jan 05, 2026
```
Signed-off-by: John Calderon <jcalderon@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  2f4e6548
05 Jan, 2026 30 commits
- [Bugfix] Properly apply v_scale for mimo_v2_flash (#31175) · 95130298
  Michael Goin authored Jan 05, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  95130298
- [Bugfix] Fix Broken ModelOpt NVFP4 MoE (#31742) · f6c0009a
  Robert Shaw authored Jan 05, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  f6c0009a
- [MoE Refactor] Aiter Experts for BF16 MoE (#31542) · 776ca1e1
  Yongye Zhu authored Jan 05, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  776ca1e1
- [Bug] Revert torch warning fix (#31585) · af9a7ec2
  Wentao Ye authored Jan 05, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  af9a7ec2
- [Cleanup] Remove deprecated fields from CachedRequestData class (#31734) · 32f4e4db
  Nick Hill authored Jan 05, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  32f4e4db
- [Model] Nemotron Parse 1.1 Support (#30864) · ee212918
  amitz-nv authored Jan 05, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ee212918
- pin lora_b moe weights on cpu (#31317) · c77a993c
  gnovack authored Jan 05, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  c77a993c
- [Misc][Model][Refactor] Pass the prefix into Linear layers (#31669) · 5708297e
  Wang Kunpeng authored Jan 06, 2026
```
Signed-off-by: Wang Kunpeng <1289706727@qq.com>
```
  5708297e
- Fix GLM-4.6v flash tool calling in transformers 5.x (#31622) · 02dbb933
  baonudesifeizhai authored Jan 05, 2026
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  02dbb933
- [Misc] Enable Paligemma's PrefixLM attention mask computation (#31725) · 51e38a8e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  51e38a8e
- Triton Attention: Support cross-layers blocks (#30687) · d8e38d49
  Or Ozeri authored Jan 05, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  d8e38d49
- [Bugfix] Add missing extra_tensors arg to DeviceCommunicatorBase.disp… (#31644) · 21156ff1
  kzwrime authored Jan 06, 2026
```
Signed-off-by: kunzh <zhikun.wu@outlook.com>
```
  21156ff1
- [Bugfix][CPU] Fix RotaryEmbedding fallback causing gibberish with --enforce-eager (#31643) · c455b771
  RickyChen / 陳昭儒 authored Jan 06, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  c455b771
- [Frontend] [Doc] Exclude log deltas feature (#30322) · 79ed460d
  Kevin Šuc authored Jan 05, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
Signed-off-by: Kevin Šuc <kevinsuc16@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  79ed460d
- [v1] Add encoder-only/cross attention support to Triton Attention backend (#31406) · 6aa5b18e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6aa5b18e
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
- [platform] Support additional forward context for OOT (#31674) · caaa482a
  zzzzwwjj authored Jan 05, 2026
```
Signed-off-by: zzzzwwjj <1183291235@qq.com>
Signed-off-by: zzzzwwjj <34335947+zzzzwwjj@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  caaa482a
- [KVconnector][LMCache] remove the import of legacy LMCache code (#31704) · b471aad4
  Yihua Cheng authored Jan 05, 2026
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  b471aad4
- [LoRA] LoRA PDL improvement (#31660) · d5503ca7
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d5503ca7
- [Model] Enable LoRA support for BLIP2 (#31620) · a2ad15c0
  Qiping Pan authored Jan 05, 2026
```
Signed-off-by: Qiping Pan <panqiping@outlook.com>
```
  a2ad15c0
- [ROCM] Reorder arguments and rename parameters for... · 3133c192
  Tres authored Jan 05, 2026
```
[ROCM] Reorder arguments and rename parameters for rope_cached_thd_positions_2c_fwd_inplace (#29993)
Signed-off-by: Tres Popp <tres.popp@amd.com>
```
  3133c192
- [Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581) · e2701cc5
  cjackal authored Jan 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e2701cc5
- [Bugfix] Fix EPLB state logging error (#31455) · fe8a9fbd
  Tyler Michael Smith authored Jan 04, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  fe8a9fbd
- [log] enable max_log_len trim only when needed (#31482) · 98b8b3ab
  Ning Xie authored Jan 05, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  98b8b3ab
- Add chat prefix completion feature to DeepSeek v3.2 (#31147) · 346e5645
  CHENYUE authored Jan 05, 2026
  
  346e5645
- [CI Failure] Fix NomicBert max_model_len validation (#31662) · 8be6432b
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8be6432b
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
- [Minor] Small pooler output processing optimization (#31667) · da436f86
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  da436f86
- [Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663) · f099cd55
  Jee Jee Li authored Jan 05, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f099cd55
04 Jan, 2026 3 commits
- [BugFix] Async scheduling: handle model forward errors more cleanly (#31611) · b53b89fd
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  b53b89fd
- [misc] Sort uvicorn log level description according to verbosity (#31137) · 6522721d
  Ning Xie authored Jan 05, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6522721d
- fix no think of GLM-4.5 / GLM-4.7 (#31449) · 0d4044ed
  Yuxuan Zhang authored Jan 04, 2026
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  0d4044ed
03 Jan, 2026 2 commits

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533) · 268b1c55

Robert Shaw authored Jan 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

268b1c55

Improve HF qwen3_omni: preserve audio_sample_rate in kwargs restructuring (#29255) · 97a01308
jeremyteboul authored Jan 02, 2026
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
97a01308

02 Jan, 2026 4 commits
- [Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454) · 0eee877f
  Xingyu Liu authored Jan 02, 2026
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
```
  0eee877f
- [MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504) · a3f2f409
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a3f2f409
- [MoE Refactor] Split `invoke_fused_moe_kernel` (#31050) · 5a468ff7
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5a468ff7
- [MoE] Fix output_shape calculation in Attention layer to handle 3D query inputs (#31596) · 6ef770df
  Andreas Karatzas authored Jan 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ef770df