Commits · 18961c5ea62976efc50525b72e40337993c5e4f9 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "df5dd3c68ec7007e4b3a27907f4d954f1c7d511d"

03 Nov, 2025 3 commits
- [Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
  Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  18961c5e
- [Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
  Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  470ad118
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
02 Nov, 2025 6 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [Misc] Provide Siglip2 chat template (#27939) · 6c317a65
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c317a65
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- Performance fix MistralTokenizer: cache special ids and tokens (#27925) · 73444b7b
  Julien Denize authored Nov 02, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  73444b7b
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
- [CI/Build] Fix flaky test_transcription_validation.py::test_basic_audio_gemma (#27924) · 758ea2e9
  Ben Browning authored Nov 01, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  758ea2e9
01 Nov, 2025 17 commits
- [KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
  Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  685c99ee
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
- [BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
  Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c2ed069b
- [Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
  wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  af6e19f5
- [Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99d69af9
- [Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
  Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
  d811b442
- [V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03
  wangxiyuan authored Nov 01, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  30a14b03
- [Docs] Mock all imports for docs (#27873) · 799ce45c
  Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  799ce45c
- feat(benchmarks): support HF model names in multi-turn benchmark (#27850) · 2c0c7c39
  ai-jz authored Nov 01, 2025
  
  2c0c7c39
- [Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188
  Yihua Cheng authored Nov 01, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6751188
- [Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
  TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  e2347dbf
- [CI/Build] Bump transformers version (#27528) · 879a0657
  Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  879a0657
- Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde
  yugong333 authored Oct 31, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  29de3cde
- [Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5
  Yan Ma authored Nov 01, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7e2729b5
- [Bugfix] Fix KDA output (#27905) · 3a5de7d2
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3a5de7d2
- [Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
  Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bc4486d6
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 14 commits

[Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
df334868

Batch invariance doc (#27839) · 0e0a638c

Bram Wasti authored Oct 31, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0e0a638c

Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
f29aeb5a

[Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9

Vinay R Damodaran authored Oct 31, 2025

Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

5e8862e9

[Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
9e5bd307
Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
fc16f1c4
fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
bc306fe5
[bugfix] Missing cached item in beam search (#27874) · 103a468b
Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
103a468b

Docs update tpu install instructions (#27824) · 70bfbd7b

Rob Mulla authored Oct 31, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Rob Mulla <RobMulla@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

70bfbd7b

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

[Bugfix] Fix broken MRoPE for GLM-4.1V/GLM-4.5V (#27860) · 7e06c40e
Isotr0py authored Nov 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7e06c40e
[Bugfix] Allow 64-bit integer values for LoRA IDs to avoid overflow/truncation (#27876) · 675704ac
Madeesh Kannan authored Oct 31, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
```
675704ac
[CI/Build] Add gpt-oss LoRA test (#27870) · 0384aa71
Jee Jee Li authored Oct 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
0384aa71
[Perf] Decouple torch op from GDA to leverage torch.compile (#27871) · 3857eb87
Jiangyun Zhu authored Oct 31, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
3857eb87