Commits · 59d53066d8daed5c2e39e3bce38ac308bc80a9ae · OpenDAS / vllm_cscc · GitLab

13 Feb, 2026 11 commits
- [Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066
  Wei Zhao authored Feb 13, 2026
```
[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  59d53066
- [Bugfix] Add quant_config in ViT of Kimi-K2.5 (#34501) · 4a9952ec
  LoganJane authored Feb 14, 2026
```
Signed-off-by: LoganJane <LoganJane73@hotmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4a9952ec
- [Misc] Port Qwen3.5 Configs (#34512) · 5885e330
  Roger Wang authored Feb 13, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  5885e330
- Extend ColBERT support to non-standard BERT backbones (#34170) · 071d863e
  Ilya Boytsov authored Feb 13, 2026
```
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
```
  071d863e
- [Perf] fused_moe: add int4_w4a16 benchmark support and tuning config (#34130) · 934acdde
  Matthias Gehre authored Feb 13, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  934acdde
- [New Model] support new model ovis2.6 (#34426) · bcf0731a
  myselvess authored Feb 13, 2026
```
Signed-off-by: myselvess <23743269+myselvess@users.noreply.github.com>
```
  bcf0731a
- [Bugfix] Fix mamba state dtype setting for Qwen3-Next and Qwen3.5 (#34489) · eea3024f
  Roger Wang authored Feb 12, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  eea3024f
- [Bugfix] Fix encoder cache underestimation for GLM-4V/GLM-OCR single image (#34483) · dcf6ee85
  haosdent authored Feb 13, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  dcf6ee85
- [Bugfix] Standardize getting number of image patches/tokens (#34358) · 372b2e76
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  372b2e76
- [Bugfix] Delete unused redundant code in Kimi-K2.5 (#34427) · 62788f99
  LoganJane authored Feb 13, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  62788f99
- [Bugfix] Remove assert that's no longer valid (#34443) · 04ea31ba
  bnellnm authored Feb 12, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  04ea31ba
12 Feb, 2026 15 commits
- [Kernel] Support Flashinfer trtllm fused MoE non gated FP8 & NVFP4 (#33506) · f120bd42
  amitz-nv authored Feb 12, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
  f120bd42
- [Bugfix] Enforce DeepGEMM when using sparse_attn_indexer on CUDA (#34374) · 6d4e27ce
  Michael Goin authored Feb 12, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d4e27ce
- [Voxtral Realtime] Refactor & Improve buffering logic (#34428) · 6c0baee6
  Patrick von Platen authored Feb 12, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6c0baee6
- [Voxstral Realtime] Enable tests (#33803) · 1100a976
  Patrick von Platen authored Feb 12, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  1100a976
- [ROCm][quantization] improve OCP weight quant parser robust (#34431) · 766e1678
  xuebwang-amd authored Feb 13, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  766e1678
- [Bugfix] Remove broken raw url GGUF model loading support (#34433) · becbe248
  Isotr0py authored Feb 13, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  becbe248
- Fix MoE for the Transformers modelling backend (#34436) · 679ca5d8
  Harry Mellor authored Feb 12, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  679ca5d8
- [Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886
  Matthew Bonanni authored Feb 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  f2c47886
- Add config file for fused MoE for Nemotron (TP4, B200) (#34411) · dea63512
  danisereb authored Feb 12, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  dea63512
- [ROCm] Enable MXFP4 MoE weight pre-shuffling on gfx950 and update aiter (#34192) · 8a798be9
  Douglas Lehr authored Feb 12, 2026
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>
```
  8a798be9
- [bugfix] refactor FunASR's _get_data_parser (#34397) · 386bfe5d
  AllenDou authored Feb 12, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  386bfe5d
- [Bugfix] Fix Sparse24 Compressed Tensors models (#33446) · e9cd6911
  Kyle Sayers authored Feb 12, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e9cd6911
- Fix DeepSeek-OCR tensor validation for all size variants (#34085) · 80f2ba6e
  Yichuan Wang authored Feb 11, 2026
```
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  80f2ba6e
- [BugFix] Fix DP chunking (#34379) · 136b0bfa
  Lucas Wilkinson authored Feb 11, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Bill Nell <bnell@redhat.com>
```
  136b0bfa
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
11 Feb, 2026 14 commits
- [Bugfix] Fix some issues with MoERunner PR #32344 (#34371) · 31d992d2
  bnellnm authored Feb 11, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  31d992d2
- [Bugfix] Fix more multimodal tests for transformers V5 (#34334) · 527ca321
  Raushan Turganbay authored Feb 11, 2026
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  527ca321
- [GPT-OSS] Remove unnecessary contiguous (#34337) · 83e26c83
  elvischenv authored Feb 12, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  83e26c83
- [Bugfix] Enable attn quantization of Llama-4 by correctly permuting scales for... · 11c7ace3
  Eldar Kurtić authored Feb 11, 2026
```
[Bugfix] Enable attn quantization of Llama-4 by correctly permuting scales for rope (int8, fp8) (#34243)
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  11c7ace3
- [Bugfix] fix default is_neox_style is True for deepseek (#34353) · be7f3d5d
  Xinyu Dong authored Feb 12, 2026
```
Signed-off-by: dongxinyu03 <dongxinyu03@baidu.com>
```
  be7f3d5d
- [Multimodal] Expose `mm_processor_kwargs` for `DummyInputsBuilder` (#34330) · 0ab06100
  Isotr0py authored Feb 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0ab06100
- [NVIDIA][test] Tests for flashinfer TRTLLM BF16 MoE (#33715) · 275e0d2a
  Linda authored Feb 11, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  275e0d2a
- Make JAIS compatible with Transformers v5 (#34264) · 0f5e55e7
  Harry Mellor authored Feb 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0f5e55e7
- Make Qwen3VL compatible with Transformers v5 (#34262) · 1e9204bf
  Harry Mellor authored Feb 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  1e9204bf
- [Bugfix][CPU] Fix llama4 inference on CPU (#34321) · 05339a7b
  Li, Jiang authored Feb 11, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  05339a7b
- [Docs] Reduce time spent generating API docs (#34255) · 40b8f553
  Harry Mellor authored Feb 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  40b8f553
- [XPU][9/N] clean up existing ipex code/doc (#34111) · cb9574eb
  Kunshang Ji authored Feb 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  cb9574eb
- [model] support FunASR model (#33247) · 21dfb842
  AllenDou authored Feb 11, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
```
  21dfb842
- [Bugfix] Fix weight naming in Qwen3.5 (#34313) · 0b20469c
  Roger Wang authored Feb 10, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0b20469c