Commits · 14561fabfd39030168a3365327d921ae5c49bb0c · OpenDAS / vllm_cscc · GitLab

24 Feb, 2026 17 commits
- [Perf] Optimize pooling model redundant copy, 1.8% throughput improvement (#35127) · 14561fab
  Wentao Ye authored Feb 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  14561fab
- [compile] Save aot compile artifacts atomically. (#35117) · c77f3e12
  Zhengxu Chen authored Feb 24, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c77f3e12
- [Feature] Add LoRA tower/connector support for Llama 4 Vision (mllama4) (#35147) · 012dee92
  Dor Huri authored Feb 24, 2026
```
Signed-off-by: dorhuri123 <dor.huri1@live.biu.ac.il>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  012dee92
- Make voxtral compile friendly (#33959) · f1c66454
  Tugsbayasgalan Manlaibaatar authored Feb 24, 2026
```
Signed-off-by: Tugsbayasgalan Manlaibaatar <tmanlaibaatar@fb.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f1c66454
- [LoRA] Update LoRA expand kernel block_n calculation (#32621) · c870eb9e
  Xin Yang authored Feb 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  c870eb9e
- [Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23
  BadrBasowid authored Feb 24, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  6af03f23
- [CI/Build] Remove redundant OpenTelemetry pip install from CI configs (#35032) · 1a6cf39d
  Vlad Tiberiu Mihailescu authored Feb 24, 2026
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  1a6cf39d
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
- [BUGFIX][Qwen3.5] Hardcode `mlp.gate` as not quantizable (#35156) · 33a0d43c
  Vadim Gimpelson authored Feb 24, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  33a0d43c
- gpu_model_runner: Cache is_encoder_decoder from model config (#35099) · 80d93fd6
  pschlan-amd authored Feb 24, 2026
```
Signed-off-by: Patrick Schlangen <pschlan@amd.com>
```
  80d93fd6
- [Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) · ec853405
  Jia Guo authored Feb 23, 2026
```
Signed-off-by: jasperjiaguo <jasperg662@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  ec853405
- [ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511
  Rohan Potdar authored Feb 23, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
```
  2ff4e511
- [Mamba1] - Change supports_update_block_table to True (#35054) · 95642441
  Asaf Gardin authored Feb 24, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  95642441
- [Bugfix] Fix lora_ids in FusedMoE LoRA test (#35135) · a7c9f7b7
  Xin Yang authored Feb 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  a7c9f7b7
- [Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a4bd661f
- [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) · 3ef9fd0f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3ef9fd0f
- [Perf] Improve default triton fused moe configs (#34846) · 22a97e66
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  22a97e66
23 Feb, 2026 23 commits
- [RL] Validation for pause_mode='keep' (#34992) · 596ed1f0
  Aaron Hao authored Feb 23, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  596ed1f0
- [Misc] Monitor interface changes (#35113) · b8d8b7e9
  Nicolò Lucchesi authored Feb 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b8d8b7e9
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- Fix custom processors that use deleted import for Transformers v5 (#35101) · 864167d3
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  864167d3
- [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) · a2ba6a52
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a2ba6a52
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
- [Bugfix] Fix MRotaryEmbedding missing `truncate` attr with YaRN scaling (#35080) · a7f341c3
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a7f341c3
- [CI] Skip Responses API (#34990) · d13ece38
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  d13ece38
- [Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445
  Mark McLoughlin authored Feb 23, 2026
```
Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  5cc7c445
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) · 1e8438a8
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Eldar Kurtic <you@example.com>
Co-authored-by: Eldar Kurtic <you@example.com>
```
  1e8438a8
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
- [ROCm][CI] Fix spec decode profile assertion and logprob test determinism (#35043) · 5f68464f
  Andreas Karatzas authored Feb 23, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5f68464f
- [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) · aa08a30f
  Vincent Gimenes authored Feb 23, 2026
```
Signed-off-by: Vincent Gimenes <vincent.gimenes@gmail.com>
```
  aa08a30f
- [Refactor] Remove dead private func `_fp8_perm` and `_extract_mask_for_item` (#35068) · 7f40e9e5
  Wentao Ye authored Feb 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7f40e9e5
- Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) · 103e614b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  103e614b
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
- fix: Apply embedding_multiplier to inputs_embeds (#34813) · e631f8e7
  Gabe Goodhart authored Feb 23, 2026
```
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e631f8e7
- [BugFix]: Fix local mypy issues (#34739) · e97c46a9
  Martin Hickey authored Feb 23, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e97c46a9
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
- [Refactor] Simplify dummy data generation (#35025) · 987506bc
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  987506bc