Commits · 4e68cc9b6aa2b9cfe8d799c2b1cd156a01bca438 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "f0f2e5638ef4858b00b137bea1c3f8312e48efa6"

30 Oct, 2025 19 commits
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [CI Failure] Fix test_kv_cache_model_load_and_run (#27717) · 1994de99
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  1994de99
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
- [Bugfix] Improve GPU validation logging in Ray fallback scenarios (#25775) · 74374386
  Sairam Pillai authored Oct 30, 2025
```
Signed-off-by: Sairam Pillai <sairam.pillai61@gmail.com>
```
  74374386
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
- [CI Failure] fix test_default_mm_loras (#27795) · c7d2a554
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c7d2a554
- [V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784) · af826e08
  wangxiyuan authored Oct 30, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  af826e08
- [BugFix][VL] Fix FA selection on Qwen2.5-VL (#27790) · e806178d
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e806178d
- [CI/Build]Add eval config for Qwen3-235B-A22B-Instruct-2507-FP8 (#27113) · 5be1bed7
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  5be1bed7
- use stringData in secret yaml to store huggingface token (#25685) · 31b55ffc
  yitingdc authored Oct 30, 2025
```
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
```
  31b55ffc
- Add more dims for batch invariant shims (#27489) · ded8ada8
  Bram Wasti authored Oct 30, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ded8ada8
- [Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for... · 8bff831f
  Kuntai Du authored Oct 29, 2025
```
[Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for performance benchmark (#25786)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  8bff831f
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
- kernels/moe test pruning (#27053) · b8c48c5d
  Fardin Hoque authored Oct 29, 2025
```
Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  b8c48c5d
- [Feat] Adds runai distributed streamer (#27230) · 17d055f5
  Benjamin Bartels authored Oct 30, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: omer-dayan <omdayan@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17d055f5
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3
- [XPU] Update latest IPEX 2.8 release (#27735) · b5bae42f
  Kunshang Ji authored Oct 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b5bae42f
- [Bugfix] mamba-block-size is set for vision language model (#27773) · d7fb10c5
  Chen Zhang authored Oct 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  d7fb10c5
- [XPU][bugfix] fix rope for llama4 and deepseek (#25145) · b798e39f
  Yan Ma authored Oct 30, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b798e39f
29 Oct, 2025 21 commits
- [Temp fix] Disable torch.compile for Qwen2.5 VL's VisionBlock temporarily. (#27760) · 48eb8eba
  Chenheli Hua authored Oct 29, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  48eb8eba
- [Bug] Fix DBO IMA issue for DeepEPHT (#27666) · b5d90f74
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b5d90f74
- [BugFix] Fix handling of resumed reqs in `SharedStorageConnector` (#27719) · d4aa1443
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d4aa1443
- [Bug] Fix DeepEP low latency `assert self.batched_router_logits.size(-1) ==... · fcb1d570
  Wentao Ye authored Oct 29, 2025
```
[Bug] Fix DeepEP low latency `assert self.batched_router_logits.size(-1) == full_router_logits.size(-1)` Bug (#27682)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  fcb1d570
- [KVConnector] Add metrics to Prometheus-Grafana dashboard (#26811) · accb8fab
  Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  accb8fab
- [Bug] Raise error explicitly if using incompatible backend (#27424) · 5b044810
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5b044810
- [CI/Build] Test torchrun with 8 cards (#27548) · f7a66828
  22quinn authored Oct 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7a66828
- `use_aot_compile` should respect `VLLM_DISABLE_COMPILE_CACHE` (#27698) · a9fe0793
  Boyuan Feng authored Oct 29, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  a9fe0793
- [FIXBUG] Qwen3VL hallucinations without Contiguous on Torch.SDPA (#27744) · 7568a282
  JartX authored Oct 29, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  7568a282
- [Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
  Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
  1da3309a
- [Chore] Optimize P2PNCCLEngine `http_address` (#27488) · 5522fb27
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5522fb27
- [CI] Fix flaky `test_two_responses_with_same_prev_id` test (#27745) · 0f95a1c3
  Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0f95a1c3
- [ROCm][Platform] Add MI308X device id in _ROCM_DEVICE_ID_NAME_MAP (#27623) · ded24e3e
  Xiake Sun authored Oct 29, 2025
```
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
```
  ded24e3e
- Fix MiniMax-M2 rmsnorm precision and remove useless code (#27627) · d6704dd0
  Roger Young authored Oct 29, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  d6704dd0
- [Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecca3fee
- [CI/Build] Skip cpu offloading test on AMD (#27690) · 9a0d2f0d
  Zhewen Li authored Oct 29, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  9a0d2f0d
- [VLM] Add Qwen3-VL generation test (#25185) · ad3ec895
  Isotr0py authored Oct 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  ad3ec895
- [chore] Remove models weight on S3 logic (#27725) · 3481e407
  Kevin H. Luu authored Oct 29, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  3481e407
- Feature/video support in random mm dataset (#25963) · 5e72216d
  Eugene Khvedchenya authored Oct 29, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenia@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  5e72216d
- [Misc] Raise error for missing video metadata in `MultiModalDataParser` (#27664) · 1a33aacf
  Isotr0py authored Oct 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1a33aacf
- [Fix] import get_kv_cache_torch_dtype error in LMCacheConnector integration (#27670) · 7ba6aa8f
  Yue Zhang authored Oct 29, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
```
  7ba6aa8f