Commits · 294c805f1df9ddf62c2290989710da9d48ab4973 · OpenDAS / vllm_cscc

"docker/Dockerfile.ppc64le" did not exist on "b640b19cc0babe256c5455befe95340f951763d9"

03 Nov, 2025 9 commits

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

[Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33

zhang-prog authored Nov 03, 2025


Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

40b69e33

[CI/Build] Remove the flaky gpt-oss lora test (#27966) · 32257297
Jee Jee Li authored Nov 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
32257297
Add ORCA endpoint load metrics support (#24905) · ba464e6a
Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
ba464e6a
[XPU]Refine Dockerfile.xpu, avoid oneccl dependency issue (#27964) · 7f4bdadb
Kunshang Ji authored Nov 03, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
7f4bdadb

[Bugfix] Padded Eagle Specdec with Chunked Prefill (#26263) · cec7c288

Rémi Delacourt authored Nov 03, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

cec7c288

[Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
18961c5e
[Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
470ad118
[BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
1bf43ae3

02 Nov, 2025 6 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [Misc] Provide Siglip2 chat template (#27939) · 6c317a65
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c317a65
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- Performance fix MistralTokenizer: cache special ids and tokens (#27925) · 73444b7b
  Julien Denize authored Nov 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  73444b7b
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
- [CI/Build] Fix flaky test_transcription_validation.py::test_basic_audio_gemma (#27924) · 758ea2e9
  Ben Browning authored Nov 01, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  758ea2e9
01 Nov, 2025 17 commits
- [KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
  Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  685c99ee
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
- [Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
  wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  af6e19f5
- [Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99d69af9
- [Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
  Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
  d811b442
- [V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03
  wangxiyuan authored Nov 01, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  30a14b03
- [Docs] Mock all imports for docs (#27873) · 799ce45c
  Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  799ce45c
- feat(benchmarks): support HF model names in multi-turn benchmark (#27850) · 2c0c7c39
  ai-jz authored Nov 01, 2025
  
  2c0c7c39
- [Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188
  Yihua Cheng authored Nov 01, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6751188
- [Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
  TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  e2347dbf
- [CI/Build] Bump transformers version (#27528) · 879a0657
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  879a0657
- Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde
  yugong333 authored Oct 31, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  29de3cde
- [Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5
  Yan Ma authored Nov 01, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7e2729b5
- [Bugfix] Fix KDA output (#27905) · 3a5de7d2
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3a5de7d2
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 8 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Batch invariance doc (#27839) · 0e0a638c
  Bram Wasti authored Oct 31, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0e0a638c
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
- fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
  ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  bc306fe5
- [bugfix] Missing cached item in beam search (#27874) · 103a468b
  Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  103a468b