Commits · 3fa2c12185da7117a63132be7520a43bcf9a4896 · OpenDAS / vllm_cscc

"docs/source/deployment/k8s.md" did not exist on "9c749713f6990a9f9d12e526d9bfc2669dfa8ee6"

23 Oct, 2025 15 commits
- [Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
```
  3fa2c121
- [CI/Build] Remove unnecessary flags from test registry (#27353) · fe2016de
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe2016de
- [Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow... · 237cf6d3
  Ilya Markov authored Oct 23, 2025
```
[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  237cf6d3
- [Feature] Pydantic validation for speculative.py (#27156) · faee3ccd
  Navya Srivastava authored Oct 23, 2025
```
Signed-off-by: Navya Srivastava <navya.srivastava1707@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  faee3ccd
- [Bugfix] Honor --mm_encoder_attn_backend when used (#27124) · 570c3e1c
  Bradley D authored Oct 23, 2025
```
Co-authored-by: Bradley D <4551889+bradleyhd@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  570c3e1c
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
- [Bugfix] Fix args settings for guided decoding args (#27375) · fc059c70
  Lucia Fang authored Oct 23, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  fc059c70
- [Chore] Remove duplicate `has_` functions in vllm.utils (#27372) · e255d929
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  e255d929
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
- [Bugfix][Core] running queue index leakage exception (#26754) · 243ed7d3
  PiteXChen authored Oct 23, 2025
```
Signed-off-by: CLFutureX <chenyongqyl@163.com>
```
  243ed7d3
- [Bugfix] Fix SLA tuner initialization (#27355) · 6738e4a0
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6738e4a0
- [Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2
  Isotr0py authored Oct 23, 2025
```
[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2566dca2
22 Oct, 2025 25 commits
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
- [BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128) · 5beacce2
  Daisy-Ma-coder authored Oct 22, 2025
```
Signed-off-by: qqma <qqma@amazon.com>
Co-authored-by: qqma <qqma@amazon.com>
```
  5beacce2
- [Feature] publisher default set zmq in kv_event config (#26915) · 8669c69a
  rongfu.leng authored Oct 23, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  8669c69a
- [Prefix Cache] Use LoRA name for consistent KV-cache block hashing (#27211) · 1651003c
  Sage authored Oct 22, 2025
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  1651003c
- [Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754
  Luciano Martins authored Oct 22, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  e05a6754
- [Bugfix] Disable FlexAttention direct block mask building for encoder-only models (#27344) · 084a9dae
  Isotr0py authored Oct 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  084a9dae
- Support Anthropic API /v1/messages Endpoint (#22627) · c9461e05
  RED authored Oct 23, 2025
```
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c9461e05
- [P/D] Dynamic `kv_output_aggregator` collect size (#26734) · 4dfdb821
  Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4dfdb821
- [Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d
  Russell Bryant authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  58fab50d
- [Bugfix] Fix HF format InternVL large variants video processing (#27330) · db6f28d8
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  db6f28d8
- [Bugfix] Make `get_mrope_input_positions` instance methods (#27342) · 14e2f123
  Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  14e2f123
- [NIXL] use Host buffer to support TP_ratio > 1 for XPU (#27140) · 7c4767f1
  Chendi.Xue authored Oct 22, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  7c4767f1
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4
- [bugfix] remove unused parameters to reduce unnecessary vram usage (#26789) · 980de31c
  Reinforce-II authored Oct 22, 2025
```
Signed-off-by: Reinforce-II <fate@eastal.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  980de31c
- [Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267) · 1c160841
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1c160841
- [NIXL] Terminate handshake listener thread in shutdown (#26404) · 4ca13a86
  Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4ca13a86
- [Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  675aa2ec
- [Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3
  dongbo910220 authored Oct 22, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  3ae082c3
- [Core] Handle MoE LoRA edge cases (#27335) · abf3db40
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  abf3db40
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
- [Log] Add Warning for `LLM(data_parallel_size=k)` single-process DP Usage (#27282) · 1a0f4def
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1a0f4def
- [Bugfix][CPU] Disable dual stream execution for experts on CPU (#27320) · 843af7f7
  Li, Jiang authored Oct 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  843af7f7
- [Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86
  wang.yuqi authored Oct 22, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1f633b86
- fixed reasoning streaming with tool_choice="required" (#24108) · a4c29e6e
  ExtReMLapin authored Oct 22, 2025
```
Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  a4c29e6e
- [1/N][Platform] Cleanup useless function (#26982) · f6027b28
  wangxiyuan authored Oct 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  f6027b28