Commits · 28c5e69ba0c4ccc9b33e05bfb757052b68af4282 · OpenDAS / vllm_cscc

"tests/models/test_llava_image_embeds.py" did not exist on "6b29d6fe709b91346be102a697bfaea386ed9107"

23 Feb, 2026 21 commits
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- Fix custom processors that use deleted import for Transformers v5 (#35101) · 864167d3
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  864167d3
- [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) · a2ba6a52
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a2ba6a52
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
- [Bugfix] Fix MRotaryEmbedding missing `truncate` attr with YaRN scaling (#35080) · a7f341c3
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a7f341c3
- [Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445
  Mark McLoughlin authored Feb 23, 2026
```
Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  5cc7c445
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) · 1e8438a8
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Eldar Kurtic <you@example.com>
Co-authored-by: Eldar Kurtic <you@example.com>
```
  1e8438a8
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
- [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) · aa08a30f
  Vincent Gimenes authored Feb 23, 2026
```
Signed-off-by: Vincent Gimenes <vincent.gimenes@gmail.com>
```
  aa08a30f
- [Refactor] Remove dead private func `_fp8_perm` and `_extract_mask_for_item` (#35068) · 7f40e9e5
  Wentao Ye authored Feb 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7f40e9e5
- Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) · 103e614b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  103e614b
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
- fix: Apply embedding_multiplier to inputs_embeds (#34813) · e631f8e7
  Gabe Goodhart authored Feb 23, 2026
```
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e631f8e7
- [BugFix]: Fix local mypy issues (#34739) · e97c46a9
  Martin Hickey authored Feb 23, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e97c46a9
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
- [Refactor] Simplify dummy data generation (#35025) · 987506bc
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  987506bc
- [Model Runner V2] Remove propose_draft method (#35070) · c645e9a2
  Woosuk Kwon authored Feb 22, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  c645e9a2
- [Model Runner V2][Minor] Remove redundant `do_spec_decode` field (#35039) · 944ffb59
  Nick Hill authored Feb 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  944ffb59
22 Feb, 2026 11 commits
- [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) · 2bcf71b9
  qizixi authored Feb 22, 2026
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  2bcf71b9
- [Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b
  tacos8me authored Feb 22, 2026
```
Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b7892a3b
- [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) · 682566b1
  Benjamin Chislett authored Feb 22, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  682566b1
- [Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative... · b9c2a565
  qizixi authored Feb 22, 2026
```
[Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative decode + prefill / decode disagg setup (#34529)
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  b9c2a565
- [Bugfix] Fix Qwen3/Qwen3.5 Reasoning Parser (#34779) · 40f88d83
  Roger Wang authored Feb 21, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  40f88d83
- [Model Runner V2] Enable CUDA graph for Eagle3 (#35040) · 2cbf9656
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2cbf9656
- Fix apply_top_k_top_p_triton called by non-cuda logits Tensor (#35030) · 30132cd1
  Xiao Li authored Feb 21, 2026
```
Signed-off-by: Xiao Li <ilx@meta.com>
```
  30132cd1
- [Benchmark] Use `sns.relplot` for plotting (#35027) · cbd95a2d
  Cyrus Leung authored Feb 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd95a2d
- [New Model] Add ColModernVBERT (#34558) · 970861ac
  Athrael Soju authored Feb 22, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>
```
  970861ac
- [Model Runner V2] Support attention group (#35036) · b71fbd06
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  b71fbd06
- [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900) · 74d90b1c
  Vadim Gimpelson authored Feb 22, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  74d90b1c
21 Feb, 2026 8 commits
- [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029) · a4047d4e
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a4047d4e
- [Frontend] Add automatic language detection for Whisper transcription (#34342) · 98b0205c
  Roman authored Feb 21, 2026
```
Signed-off-by: space_check <roman.vuskov@rwth-aachen.de>
Signed-off-by: Roman <45857014+spacecheck@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  98b0205c
- [Benchmark] Improve benchmarks (#35012) · f74f1572
  Cyrus Leung authored Feb 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f74f1572
- [Core] Minor structured-output related scheduler optimization (#34765) · 820d7815
  Nick Hill authored Feb 21, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  820d7815
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
- [ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
  BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
  8dc8a99b
- [ROCM] Optimize ROCM_AITER_FA spec decode eagle performance (#34541) · 2aab2bb5
  jennyyyyzhen authored Feb 20, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
```
  2aab2bb5
- [ROCm][AITER] Fix aiter paged_attention_v1 decode for sliding window and head_size < 64 (#34570) · cf93c1a1
  Andreas Karatzas authored Feb 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  cf93c1a1