Commits · 77f8001f533021ece46779f5b7e69edc1d3b514f · OpenDAS / vllm_cscc

"tests/kernels/moe/untest_deepgemm.py" did not exist on "1eb2b9c10205b68658dede9dac73390706ef2e05"

04 Nov, 2025 12 commits
- [Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968) · 77f8001f
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  77f8001f
- [Core] Enable StatLogger in LLMEngine (#28020) · 300a2659
  Zhuohan Li authored Nov 04, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  300a2659
- Support using Int4PreshuffledTensor after loading (#26066) · 03c4c4aa
  Jerry Zhang authored Nov 04, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  03c4c4aa
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc
- [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) · 4022a9d2
  Varun Sundar Rabindranath authored Nov 04, 2025
  
  4022a9d2
- [Model] fix ernie45 reasoning_parser (#27973) · 43a6acfb
  CSWYF3634076 authored Nov 04, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  43a6acfb
- [KV Connector] Make KVCacheConfig an explicit constructor argument (#27887) · 58279c60
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  58279c60
- [Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata... · 7e4be741
  Wentao Ye authored Nov 04, 2025
```
[Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata must have shape (metadata_size)` (#27884)
```
  7e4be741
- [Metrics] Enable sleep state metric outside of dev mode (#27867) · 380ba681
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  380ba681
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb
- [LoRA] Lora shrink swizzle (#27694) · 6ddae740
  li2haipeng authored Nov 03, 2025
```
Signed-off-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>
Signed-off-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6ddae740
- [Bugfix][ROCm] Fix ViT rotary embeddings for torch.compile compatibility on ROCm (#27748) · b13a4475
  vllmellm authored Nov 04, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  b13a4475
03 Nov, 2025 15 commits
- [Bugfix] Fix MoE Routing Simulation (#28002) · 37587573
  Tyler Michael Smith authored Nov 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  37587573
- [Bugfix][plugin] fla crash on plugin (#27322) · ccd3e55e
  Hank_ authored Nov 04, 2025
  
  ccd3e55e
- [Docs] add runai_streamer_sharded to LoadConfig (#27937) · 78603072
  Ning Xie authored Nov 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  78603072
- [Bugfix] change FlashMLA reorder_batch_threshold (#27777) · 145c00a4
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  145c00a4
- [Bugfix][Qwen][Multimodal] Move Qwen2_5_vl sdpa to custom op and reenable compile (#27764) · 55011aef
  Lucas Kabela authored Nov 03, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  55011aef
- [Feature][Benchmarks] Support `inf` burstiness (#26941) · a4398fbb
  Sophie du Couédic authored Nov 03, 2025
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  a4398fbb
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e
  ahao-anyscale authored Nov 03, 2025
```
[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cac4c10e
- [Bugfix] Skip gs:// model paths for speculator detection (#27846) · f7d2946e
  pwschuurman authored Nov 03, 2025
```
Signed-off-by: Peter Schuurman <psch@google.com>
```
  f7d2946e
- Early exit for MoE LoRA kernels (#27131) · 294c805f
  gnovack authored Nov 03, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294c805f
- [Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33
  zhang-prog authored Nov 03, 2025
```
Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40b69e33
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
- [Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
  Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  18961c5e
- [Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
  Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  470ad118
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
02 Nov, 2025 5 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [Misc] Provide Siglip2 chat template (#27939) · 6c317a65
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c317a65
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- Performance fix MistralTokenizer: cache special ids and tokens (#27925) · 73444b7b
  Julien Denize authored Nov 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  73444b7b
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
01 Nov, 2025 8 commits
- [KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
  Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  685c99ee
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
- [Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
  wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  af6e19f5
- [Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99d69af9
- [Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
  Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
  d811b442
- [V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03
  wangxiyuan authored Nov 01, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  30a14b03
- [Docs] Mock all imports for docs (#27873) · 799ce45c
  Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  799ce45c