Commits · 9ea07b41da169f727a2eb7302adec4c724319522 · OpenDAS / vllm_cscc

"vllm/model_executor/models/step1.py" did not exist on "4f5b059f146adeecd153fa781cf21863ed6679d8"

14 Jan, 2026 18 commits
- [1/N] Reorganize multimodal processing code (#32327) · 9ea07b41
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ea07b41
- rename tokenize serving api request id prefix to tokenize (#32328) · 552b2629
  Ning Xie authored Jan 14, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  552b2629
- [Frontend] track responsesAPI server_load (#32323) · 00e6402d
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  00e6402d
- [Misc] Make mem utils can be reused by other platforms (#32322) · ce094624
  Shanshan Shen authored Jan 14, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  ce094624
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] Move top-level dummy data generation to registry (#32310) · 90db5b31
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90db5b31
- [Model] Re-implement Qwen3Omni Audio Encoder (#32167) · b8199f60
  Roger Wang authored Jan 13, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  b8199f60
- Add Molmo2 multimodal model support (#30997) · 7e6f1238
  sangho.lee authored Jan 13, 2026
```
Signed-off-by: sanghol <sanghol@allenai.org>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7e6f1238
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
- [Docs] Add docs about OOT Quantization Plugins (#32035) · 6388b500
  Michael Goin authored Jan 14, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6388b500
- AMD CI Test - unskip moe_sum test and moe_align_block_size tests (#32039) · 048bb597
  Hongxia Yang authored Jan 14, 2026
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  048bb597
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
- [Build] Relax anthropic version pin from ==0.71.0 to >=0.71.0 (#32289) · 6b176095
  David authored Jan 14, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6b176095
- [ROCm][CI] Handle missing vision_config in Isaac model attention patch (#32281) · 9d0d7f48
  Andreas Karatzas authored Jan 14, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9d0d7f48
- Consolidate Intel Quantization Toolkit Integration in vLLM (#31716) · 50632adc
  Yi Liu authored Jan 14, 2026
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  50632adc
- [ROCm][CI] Disable Async Scheduling For Qwen3-Next-80B-A3B-Instruct MTP Async... · 6fa6e7ef
  Micah Williamson authored Jan 13, 2026
```
[ROCm][CI] Disable Async Scheduling For Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test (#32275)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  6fa6e7ef
- [Model Runner V2] Refactor Sampler (#32245) · 90c08369
  Woosuk Kwon authored Jan 13, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  90c08369
13 Jan, 2026 22 commits
- [Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a
  Roberto L. Castro authored Jan 14, 2026
```
Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  8ef50d9a
- [Improvement] Persist CUDA compat libraries paths to prevent reset on `apt-get` (#30784) · 2a60ac91
  emricksini-h authored Jan 13, 2026
```
Signed-off-by: emricksini-h <emrick.birivoutin@hcompany.ai>
```
  2a60ac91
- Add mergify label job for "bug" in PR titles (#31980) · 9e65bb4e
  Michael Goin authored Jan 13, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9e65bb4e
- [Build] Add scripts for cherry-picking and trigger build (#32282) · 0db574b1
  Simon Mo authored Jan 13, 2026
```
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
```
  0db574b1
- [Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502) · 2f4a71da
  HappyAmazonian authored Jan 13, 2026
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Signed-off-by: HappyAmazonian <91216626+HappyAmazonian@users.noreply.github.com>
```
  2f4a71da
- fix(rocm): Use refresh_env_variables() for rocm_aiter_ops in test_moe (#31711) · 69f8a0ea
  Rabi Mishra authored Jan 14, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  69f8a0ea
- [Perf] Optimize grouped topk kernel, 1.2%~2% E2E Throughput improvement (#32058) · f28125d8
  Wentao Ye authored Jan 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f28125d8
- Fix CUDA 13 wheel installation doc (#32276) · 46f8c6b7
  Dmitry Tokarev authored Jan 13, 2026
```
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
```
  46f8c6b7
- [responseAPI] support partial message generation (#32100) · af54d2e2
  Andrew Xia authored Jan 13, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  af54d2e2
- [EPLB][Cleanup] Remove `is_async_enabled` from `EplbModelState` (#32050) · 6beef12b
  Sage Moore authored Jan 13, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  6beef12b
- [Trivial] Remove duplicate enable_mfu_metrics (#32246) · ab74b2a2
  Mark McLoughlin authored Jan 13, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  ab74b2a2
- [4/N][Attention] Move MLA common to model_executor (#32060) · 2263d44b
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  2263d44b
- nixl_connector: export UCX_MEM_MMAP_HOOK_MODE=none to avoid a UCX memory leak (#32181) · 4f3676e7
  Mathis Felardos authored Jan 13, 2026
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  4f3676e7
- [BugFix] [KVConnector] Fix KV events for LMCache connector (#32169) · 51026547
  Martin Hickey authored Jan 13, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  51026547
- [Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251) · 4f02cb2e
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4f02cb2e
- [Refactor] Remove `MultiModalProfiler` (#32254) · 252c0110
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  252c0110
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Quantization] fix: overflow with static per-tensor scaling (#29867) · a5bbbd2f
  Mickaël Seznec authored Jan 13, 2026
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  a5bbbd2f
- [Docs] Nixl Usage recommend `fail` kv_load_failure_policy (#32198) · 8c8653b6
  Nicolò Lucchesi authored Jan 13, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8c8653b6
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
- [Refactor] Remove `get_encoder_dummy_data` (#32241) · eb28e806
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eb28e806