Commits · 145c00a4d32b7a681f7fb936c9575812c7aa7880 · OpenDAS / vllm_cscc

"examples/vscode:/vscode.git/clone" did not exist on "27c24b3f75747d300bb96bf25e687a9a1260ee32"

03 Nov, 2025 12 commits
- [Bugfix] change FlashMLA reorder_batch_threshold (#27777) · 145c00a4
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  145c00a4
- [Bugfix][Qwen][Multimodal] Move Qwen2_5_vl sdpa to custom op and reenable compile (#27764) · 55011aef
  Lucas Kabela authored Nov 03, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  55011aef
- [Feature][Benchmarks] Support `inf` burstiness (#26941) · a4398fbb
  Sophie du Couédic authored Nov 03, 2025
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  a4398fbb
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e
  ahao-anyscale authored Nov 03, 2025
```
[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cac4c10e
- [Bugfix] Skip gs:// model paths for speculator detection (#27846) · f7d2946e
  pwschuurman authored Nov 03, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  f7d2946e
- Early exit for MoE LoRA kernels (#27131) · 294c805f
  gnovack authored Nov 03, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294c805f
- [Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33
  zhang-prog authored Nov 03, 2025
```
Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40b69e33
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
- [Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
  Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  18961c5e
- [Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
  Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  470ad118
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
02 Nov, 2025 5 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [Misc] Provide Siglip2 chat template (#27939) · 6c317a65
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c317a65
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- Performance fix MistralTokenizer: cache special ids and tokens (#27925) · 73444b7b
  Julien Denize authored Nov 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  73444b7b
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
01 Nov, 2025 16 commits
- [KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
  Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  685c99ee
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
- [Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
  wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  af6e19f5
- [Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99d69af9
- [Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
  Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
  d811b442
- [V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03
  wangxiyuan authored Nov 01, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  30a14b03
- [Docs] Mock all imports for docs (#27873) · 799ce45c
  Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  799ce45c
- [Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188
  Yihua Cheng authored Nov 01, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6751188
- [Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
  TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  e2347dbf
- [CI/Build] Bump transformers version (#27528) · 879a0657
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  879a0657
- Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde
  yugong333 authored Oct 31, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  29de3cde
- [Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5
  Yan Ma authored Nov 01, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7e2729b5
- [Bugfix] Fix KDA output (#27905) · 3a5de7d2
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3a5de7d2
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 7 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
- fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
  ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  bc306fe5
- [bugfix] Missing cached item in beam search (#27874) · 103a468b
  Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  103a468b