Commits · b853540388bf8c796e1c88dabceaeebaab73621e · OpenDAS / vllm_cscc

25 Oct, 2025 2 commits
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
- [CI] Add tests for cudagraph (#27391) · 29c9cb80
  Jiangyun Zhu authored Oct 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  29c9cb80
24 Oct, 2025 9 commits
- [CI/Build] Fix test_torch_utils in AMD CI (#27317) · fc168c33
  Zhewen Li authored Oct 24, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  fc168c33
- [Bugfix] Fix MultiConnector stats reconstruction across process boundaries (#27366) · 7e1d697b
  kourosh hakhamaneshi authored Oct 24, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7e1d697b
- Fix test named tool use (#27458) · 41a62564
  Chauncey authored Oct 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  41a62564
- [MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  284cc922
- [Refactor] move tool parsing logic from protocol.py to the tool parser (#27383) · 35678169
  Chauncey authored Oct 24, 2025
```
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  35678169
- [Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) · 07447554
  strinczer authored Oct 24, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  07447554
- Fix EventPublisherFactory logic for disabled KV cache events (#27419) · c528b900
  usberkeley authored Oct 24, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  c528b900
- [Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  85fee74b
- [Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by... · 5cc6bddb
  Xiangyu Li authored Oct 24, 2025
```
[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)
```
  5cc6bddb
23 Oct, 2025 13 commits
- [Model] Siglip Embedding Support (#27324) · 0552cfb1
  Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  0552cfb1
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [Misc] Add triton_kernels dependency (#27370) · a9f55dc5
  Varun Sundar Rabindranath authored Oct 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  a9f55dc5
- [Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
```
  3fa2c121
- [CI/Build] Remove unnecessary flags from test registry (#27353) · fe2016de
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe2016de
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
- [CI] Reorganize entrypoints tests (#27403) · d00ce29d
  Chauncey authored Oct 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d00ce29d
- [CI/Build] Fix AMD CI: test_cpu_gpu.py (#27388) · 50b788a1
  Zhewen Li authored Oct 23, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  50b788a1
- [CI/Build] Fix Prithvi plugin test (#27393) · bfb240cc
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bfb240cc
- [Model] Add num_cached_tokens for PoolingRequestOutput (#27378) · 3729ed00
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  3729ed00
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
- [Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2
  Isotr0py authored Oct 23, 2025
```
[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2566dca2
22 Oct, 2025 16 commits

[Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
a0003b56
[Prefix Cache] Use LoRA name for consistent KV-cache block hashing (#27211) · 1651003c
Sage authored Oct 22, 2025
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
1651003c

[Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754

Luciano Martins authored Oct 22, 2025


Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

e05a6754

Support Anthropic API /v1/messages Endpoint (#22627) · c9461e05

RED authored Oct 23, 2025


Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

c9461e05

[P/D] Dynamic `kv_output_aggregator` collect size (#26734) · 4dfdb821
Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
4dfdb821

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

[NIXL] Terminate handshake listener thread in shutdown (#26404) · 4ca13a86
Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
4ca13a86

[Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec

Isotr0py authored Oct 22, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

675aa2ec

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
8e4ca4d1

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

fixed reasoning streaming with tool_choice="required" (#24108) · a4c29e6e

ExtReMLapin authored Oct 22, 2025

Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

a4c29e6e

Remove last `level` references not removed in #26355 (#27260) · 8f18feb1
Harry Mellor authored Oct 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
8f18feb1
[1/N][Platform] Cleanup useless function (#26982) · f6027b28
wangxiyuan authored Oct 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
f6027b28
[torch.compile] Enable silu_mul_fp8_quant fusion without custom ops enabled (#27146) · ab3e8004
Jiangyun Zhu authored Oct 22, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ab3e8004
[CI] Nixl integration tests DP-EP (#27199) · bfa59be8
Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
bfa59be8