Commits · 61089465a6101790635ed96c26df3e9a57d8d2c9 · OpenDAS / vllm_cscc · GitLab

"docker/Dockerfile" did not exist on "e784c6b9984e8f8116f74000b863d941495acb0b"

23 Oct, 2025 15 commits
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
- [CI] Reorganize entrypoints tests (#27403) · d00ce29d
  Chauncey authored Oct 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d00ce29d
- add SLA information into comparison graph for vLLM Benchmark Suite (#25525) · 3b7bdf98
  Louie Tsai authored Oct 23, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: louie-tsai <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  3b7bdf98
- [CI/Build] Fix AMD CI: test_cpu_gpu.py (#27388) · 50b788a1
  Zhewen Li authored Oct 23, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  50b788a1
- [Bugfix] Fix args settings for guided decoding args (#27375) · fc059c70
  Lucia Fang authored Oct 23, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  fc059c70
- [CI/Build] Fix Prithvi plugin test (#27393) · bfb240cc
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bfb240cc
- [Chore] Remove duplicate `has_` functions in vllm.utils (#27372) · e255d929
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  e255d929
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
- [Bugfix][Core] running queue index leakage exception (#26754) · 243ed7d3
  PiteXChen authored Oct 23, 2025
```
Signed-off-by: CLFutureX <chenyongqyl@163.com>
```
  243ed7d3
- [Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133) · 7e094105
  fangpings authored Oct 22, 2025
```
Signed-off-by: Fangping Shi <fangping_shi@apple.com>
Co-authored-by: Fangping Shi <fangping_shi@apple.com>
```
  7e094105
- [Bugfix] Fix SLA tuner initialization (#27355) · 6738e4a0
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6738e4a0
- [Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2
  Isotr0py authored Oct 23, 2025
```
[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2566dca2
22 Oct, 2025 25 commits
- [MLA] Bump FlashMLA (#27354) · b4fda58a
  Matthew Bonanni authored Oct 22, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  b4fda58a
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
- [BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128) · 5beacce2
  Daisy-Ma-coder authored Oct 22, 2025
```
Signed-off-by: qqma <qqma@amazon.com>
Co-authored-by: qqma <qqma@amazon.com>
```
  5beacce2
- [Feature] publisher default set zmq in kv_event config (#26915) · 8669c69a
  rongfu.leng authored Oct 23, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  8669c69a
- [Prefix Cache] Use LoRA name for consistent KV-cache block hashing (#27211) · 1651003c
  Sage authored Oct 22, 2025
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  1651003c
- [Doc] Fix numbering sequence in prefix caching (#27357) · 1cb8c6c5
  William Song authored Oct 23, 2025
```
Signed-off-by: William Song <jinwook@umich.edu>
```
  1cb8c6c5
- [Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754
  Luciano Martins authored Oct 22, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  e05a6754
- [Bugfix] Disable FlexAttention direct block mask building for encoder-only models (#27344) · 084a9dae
  Isotr0py authored Oct 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  084a9dae
- Support Anthropic API /v1/messages Endpoint (#22627) · c9461e05
  RED authored Oct 23, 2025
```
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c9461e05
- [P/D] Dynamic `kv_output_aggregator` collect size (#26734) · 4dfdb821
  Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4dfdb821
- [Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d
  Russell Bryant authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  58fab50d
- [Bugfix] Fix HF format InternVL large variants video processing (#27330) · db6f28d8
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  db6f28d8
- [Bugfix] Make `get_mrope_input_positions` instance methods (#27342) · 14e2f123
  Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  14e2f123
- [NIXL] use Host buffer to support TP_ratio > 1 for XPU (#27140) · 7c4767f1
  Chendi.Xue authored Oct 22, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  7c4767f1
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4
- [bugfix] remove unused parameters to reduce unnecessary vram usage (#26789) · 980de31c
  Reinforce-II authored Oct 22, 2025
```
Signed-off-by: Reinforce-II <fate@eastal.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  980de31c
- [Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267) · 1c160841
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1c160841
- [NIXL] Terminate handshake listener thread in shutdown (#26404) · 4ca13a86
  Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4ca13a86
- [Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  675aa2ec
- [Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3
  dongbo910220 authored Oct 22, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  3ae082c3
- Mirroring changes in test-pipeline.yaml into test-amd.yaml (#27242) · 49c00fe3
  Alexei-V-Ivanov-AMD authored Oct 22, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  49c00fe3
- [docs] Update v1 metrics design doc (#27332) · 141d3b9f
  Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: atalhens <sneh.lata@nutanix.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: atalhens <sneh.lata@nutanix.com>
```
  141d3b9f
- [Core] Handle MoE LoRA edge cases (#27335) · abf3db40
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  abf3db40
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
- [Log] Add Warning for `LLM(data_parallel_size=k)` single-process DP Usage (#27282) · 1a0f4def
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1a0f4def