Commits · 252c011012658490c2e970c5bc739a84bf5759c0 · OpenDAS / vllm_cscc · GitLab

13 Jan, 2026 21 commits
- [Refactor] Remove `MultiModalProfiler` (#32254) · 252c0110
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  252c0110
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Quantization] fix: overflow with static per-tensor scaling (#29867) · a5bbbd2f
  Mickaël Seznec authored Jan 13, 2026
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  a5bbbd2f
- [Docs] Nixl Usage recommend `fail` kv_load_failure_policy (#32198) · 8c8653b6
  Nicolò Lucchesi authored Jan 13, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8c8653b6
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
- [Refactor] Remove `get_encoder_dummy_data` (#32241) · eb28e806
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eb28e806
- [Model] Use mm_position to compute mrope positions for Qwen2-VL/2.5-VL (#32126) · 542a4059
  YunzhuLu authored Jan 13, 2026
```
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  542a4059
- [ROCm][CI] Fix engine core client tests for ROCm spawn multiprocessing (#32061) · df7e1271
  Andreas Karatzas authored Jan 13, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  df7e1271
- [Doc] Update installation from source command (#32239) · 44c34f22
  Roy Wang authored Jan 13, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  44c34f22
- [BugFix]Fix eagle draft_model_config and add tests (#31753) · 80221e18
  Xingyu Liu authored Jan 12, 2026
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
```
  80221e18
- [ROCm][CI] Fix HuggingFace flash_attention_2 accuracy issue in Isaac vision encoder (#32233) · 5e714f7f
  Andreas Karatzas authored Jan 13, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5e714f7f
- [ROCm][Bugfix] Fix Mamba batched decode producing incorrect output (#32099) · 11b6af52
  Andreas Karatzas authored Jan 12, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  11b6af52
- [Perf] Optimize requests abort (#32211) · 2a719e08
  Wentao Ye authored Jan 12, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2a719e08
- Fix various typos found in `docs` (#32212) · f243abc9
  Andrew Bennett authored Jan 12, 2026
```
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
```
  f243abc9
- [Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956) · 60b77e14
  Sanghoon Yoon authored Jan 13, 2026
```
Signed-off-by: Sanghoon Yoon <seanyoon@kakao.com>
```
  60b77e14
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
- [BugFix] Fix engine crash caused by chat tools + response_format (#32127) · c6bb5b56
  Nick Hill authored Jan 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c6bb5b56
- [Misc] Allow enabling NCCL for DP sync when async scheduling (#32197) · 9273a427
  Nick Hill authored Jan 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9273a427
- [Model] Handle `trust_remote_code` for transformers backend (#32194) · 78d13ea9
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  78d13ea9
- [responsesAPI] add unit test for optional function tool call id (#32036) · a307ac07
  Andrew Xia authored Jan 12, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  a307ac07
12 Jan, 2026 19 commits
- [ROCm][CI] Handle pytest status code 5 when a shard isn't allocated any tests (#32040) · a28d9f44
  Divakar Verma authored Jan 12, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  a28d9f44
- [Kernel][MoE] fix computation order of MoE weight multiplication and improve flow (#31962) · 629584bf
  xuebwang-amd authored Jan 13, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  629584bf
- [Model Runner V2] Add support for M-RoPE (#32143) · 0a7dd237
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0a7dd237
- [Model Runner V2] Minor refactor for logit_bias (#32209) · dec28688
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dec28688
- [BUGFIX] Add missed remaping of the names of fp8 kv-scale (#32199) · 9f430c94
  Vadim Gimpelson authored Jan 13, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  9f430c94
- [NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031) · f8bd8394
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f8bd8394
- [Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163) · ca81811b
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca81811b
- [Misc][BE] Type coverage for vllm/compilation [3/3] (#31748) · ad8818bb
  Lucas Kabela authored Jan 12, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ad8818bb
- [Misc] Change log level for batch queue log (#32192) · 08e8e99c
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  08e8e99c
- [BugFix] scheduler: Fix ordering preserving of skipped requests (#32173) · 2be765b6
  Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  2be765b6
- [Misc] Set default torch num threads for input processing (#31879) · 16abe6b8
  Roger Wang authored Jan 12, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  16abe6b8
- [Refactor] EPLB rebalance algo to NumPy (#30697) · 1eb61ab3
  Ilya Markov authored Jan 12, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  1eb61ab3
- [BugFix] fix FusedMoE.make_expert_params_mapping in EXAONE-MoE (#32196) · 3d962d72
  Kyungmin Lee authored Jan 13, 2026
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
```
  3d962d72
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
- [Benchmark] Share data between SLA runs (#32184) · 7c0d3c51
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c0d3c51
- [Misc][PD] Fix `get_attn_backend` usage in transfer connectors (#31988) · 5b681074
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5b681074
- [Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118) · 8fb2c135
  Asaf Joseph Gardin authored Jan 12, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  8fb2c135
- [Model] Standardize pooling heads (#32148) · 8863c2b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8863c2b2
- [FIX] Add NO_MUL activation support for modular kernel path (#31528) · 3f72639d
  danielafrimi authored Jan 12, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Signed-off-by: <>
Co-authored-by: root <root@gpu-267.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-537.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: root <root@pool0-01777.cm.cluster>
```
  3f72639d