Commits · a4bd661fb33b94e952b598624f1b9e60f380d325 · OpenDAS / vllm_cscc · GitLab

24 Feb, 2026 3 commits
- [Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a4bd661f
- [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) · 3ef9fd0f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3ef9fd0f
- [Perf] Improve default triton fused moe configs (#34846) · 22a97e66
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  22a97e66
23 Feb, 2026 25 commits
- [RL] Validation for pause_mode='keep' (#34992) · 596ed1f0
  Aaron Hao authored Feb 23, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  596ed1f0
- [Misc] Monitor interface changes (#35113) · b8d8b7e9
  Nicolò Lucchesi authored Feb 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b8d8b7e9
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- Fix custom processors that use deleted import for Transformers v5 (#35101) · 864167d3
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  864167d3
- [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) · a2ba6a52
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a2ba6a52
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
- [Bugfix] Fix MRotaryEmbedding missing `truncate` attr with YaRN scaling (#35080) · a7f341c3
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a7f341c3
- [CI] Skip Responses API (#34990) · d13ece38
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  d13ece38
- [Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445
  Mark McLoughlin authored Feb 23, 2026
```
Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  5cc7c445
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) · 1e8438a8
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Eldar Kurtic <you@example.com>
Co-authored-by: Eldar Kurtic <you@example.com>
```
  1e8438a8
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
- [ROCm][CI] Fix spec decode profile assertion and logprob test determinism (#35043) · 5f68464f
  Andreas Karatzas authored Feb 23, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5f68464f
- [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) · aa08a30f
  Vincent Gimenes authored Feb 23, 2026
```
Signed-off-by: Vincent Gimenes <vincent.gimenes@gmail.com>
```
  aa08a30f
- [Refactor] Remove dead private func `_fp8_perm` and `_extract_mask_for_item` (#35068) · 7f40e9e5
  Wentao Ye authored Feb 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7f40e9e5
- Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) · 103e614b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  103e614b
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
- fix: Apply embedding_multiplier to inputs_embeds (#34813) · e631f8e7
  Gabe Goodhart authored Feb 23, 2026
```
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e631f8e7
- [BugFix]: Fix local mypy issues (#34739) · e97c46a9
  Martin Hickey authored Feb 23, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e97c46a9
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
- [Refactor] Simplify dummy data generation (#35025) · 987506bc
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  987506bc
- [Model Runner V2] Remove propose_draft method (#35070) · c645e9a2
  Woosuk Kwon authored Feb 22, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  c645e9a2
- [Model Runner V2][Minor] Remove redundant `do_spec_decode` field (#35039) · 944ffb59
  Nick Hill authored Feb 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  944ffb59
22 Feb, 2026 12 commits
- [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) · 2bcf71b9
  qizixi authored Feb 22, 2026
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  2bcf71b9
- [Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b
  tacos8me authored Feb 22, 2026
```
Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b7892a3b
- [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) · 682566b1
  Benjamin Chislett authored Feb 22, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  682566b1
- [Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative... · b9c2a565
  qizixi authored Feb 22, 2026
```
[Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative decode + prefill / decode disagg setup (#34529)
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  b9c2a565
- [ROCm][CI] Fix realtime test timeouts caused by aiter JIT compilation delays (#35052) · dd8c3a7f
  Andreas Karatzas authored Feb 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  dd8c3a7f
- [ROCm][CI] Fix flaky embedding chat test by using tolerance-based comparison (#35050) · a8a47c17
  Andreas Karatzas authored Feb 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8a47c17
- [Bugfix] Fix Qwen3/Qwen3.5 Reasoning Parser (#34779) · 40f88d83
  Roger Wang authored Feb 21, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  40f88d83
- [Model Runner V2] Enable CUDA graph for Eagle3 (#35040) · 2cbf9656
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2cbf9656
- Fix apply_top_k_top_p_triton called by non-cuda logits Tensor (#35030) · 30132cd1
  Xiao Li authored Feb 21, 2026
```
Signed-off-by: Xiao Li <ilx@meta.com>
```
  30132cd1
- [Benchmark] Use `sns.relplot` for plotting (#35027) · cbd95a2d
  Cyrus Leung authored Feb 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd95a2d
- [New Model] Add ColModernVBERT (#34558) · 970861ac
  Athrael Soju authored Feb 22, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>
```
  970861ac
- [CI] Bump mteb version to `mteb[bm25s]>=2, <3` for pooling model unit tests (#34961) · d24bdd7c
  Wentao Ye authored Feb 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d24bdd7c