Commits · 43a6acfb7de8c7ad839d41bc2109fafe692b77ba · OpenDAS / vllm_cscc

"deploy/snapshot/internal/cuda/cuda.go" did not exist on "045eedebecc7d2d7ed355926c5e0fc8feca3cf2d"

04 Nov, 2025 7 commits
- [Model] fix ernie45 reasoning_parser (#27973) · 43a6acfb
  CSWYF3634076 authored Nov 04, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  43a6acfb
- [KV Connector] Make KVCacheConfig an explicit constructor argument (#27887) · 58279c60
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  58279c60
- [Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata... · 7e4be741
  Wentao Ye authored Nov 04, 2025
```
[Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata must have shape (metadata_size)` (#27884)
```
  7e4be741
- [Metrics] Enable sleep state metric outside of dev mode (#27867) · 380ba681
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  380ba681
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb
- [LoRA] Lora shrink swizzle (#27694) · 6ddae740
  li2haipeng authored Nov 03, 2025
```
Signed-off-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>
Signed-off-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6ddae740
- [Bugfix][ROCm] Fix ViT rotary embeddings for torch.compile compatibility on ROCm (#27748) · b13a4475
  vllmellm authored Nov 04, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  b13a4475
03 Nov, 2025 15 commits
- [Bugfix] Fix MoE Routing Simulation (#28002) · 37587573
  Tyler Michael Smith authored Nov 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  37587573
- [Bugfix][plugin] fla crash on plugin (#27322) · ccd3e55e
  Hank_ authored Nov 04, 2025
  
  ccd3e55e
- [Docs] add runai_streamer_sharded to LoadConfig (#27937) · 78603072
  Ning Xie authored Nov 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  78603072
- [Bugfix] change FlashMLA reorder_batch_threshold (#27777) · 145c00a4
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  145c00a4
- [Bugfix][Qwen][Multimodal] Move Qwen2_5_vl sdpa to custom op and reenable compile (#27764) · 55011aef
  Lucas Kabela authored Nov 03, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  55011aef
- [Feature][Benchmarks] Support `inf` burstiness (#26941) · a4398fbb
  Sophie du Couédic authored Nov 03, 2025
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  a4398fbb
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e
  ahao-anyscale authored Nov 03, 2025
```
[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cac4c10e
- [Bugfix] Skip gs:// model paths for speculator detection (#27846) · f7d2946e
  pwschuurman authored Nov 03, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  f7d2946e
- Early exit for MoE LoRA kernels (#27131) · 294c805f
  gnovack authored Nov 03, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294c805f
- [Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33
  zhang-prog authored Nov 03, 2025
```
Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40b69e33
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
- [Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
  Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  18961c5e
- [Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
  Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  470ad118
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
02 Nov, 2025 5 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [Misc] Provide Siglip2 chat template (#27939) · 6c317a65
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c317a65
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- Performance fix MistralTokenizer: cache special ids and tokens (#27925) · 73444b7b
  Julien Denize authored Nov 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  73444b7b
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
01 Nov, 2025 13 commits

[KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
685c99ee
Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
1e88fb75
[BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
c2ed069b
[Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
af6e19f5
[Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
99d69af9
[Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
d811b442

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03

wangxiyuan authored Nov 01, 2025


Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

30a14b03

[Docs] Mock all imports for docs (#27873) · 799ce45c
Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
799ce45c

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

[Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
e2347dbf

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde

yugong333 authored Oct 31, 2025


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

29de3cde

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5