Commits · 155ad56d7b567441685a8f8ebf51b7077e68e054 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "d394787e5268903a705850413e494ebf2ddcefb5"

07 Nov, 2025 21 commits
- [doc] add guide about the provided PTX was compiled with an unsupported toolchain (#28305) · 155ad56d
  youkaichao authored Nov 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  155ad56d
- [README] Add Arm CPUs to the list of supported targets (#28290) · 5fb4137c
  Fadi Arafeh authored Nov 07, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  5fb4137c
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
- [Log] update shm wait time msg (#28255) · 0f872b79
  Boyuan Feng authored Nov 07, 2025
  
  0f872b79
- [Feature] Default `ignore_eos` True for `random` dataset (#28227) · 4b1ff132
  Wentao Ye authored Nov 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4b1ff132
- [CLI] add --max-tokens to `vllm complete` (#28109) · e0d6b4a8
  Iceber Gu authored Nov 07, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  e0d6b4a8
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
- [fix] Revert "fixing mm placeholder replacement issue with gemma3" (#28285) · 8e19d470
  Kevin H. Luu authored Nov 07, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  8e19d470
- [Misc][Model][Refactor] Pass the prefix into Linear layers (#28259) · 1958bda9
  Mengqing Cao authored Nov 07, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  1958bda9
- [CPU]Avoid repeated random sample compile (#28260) · 7bdb42b2
  Zhang Xiangze authored Nov 07, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  7bdb42b2
- [FixBug]Aeala/ShareGPT_Vicuna_unfiltered marked as multimodal benchmark (#28265) · 315068eb
  汪志鹏 authored Nov 07, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  315068eb
- [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171) · ccd98b59
  Jialin Ouyang authored Nov 07, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ccd98b59
- [Kernel] LoRA triton kernels support PDL (#27402) · 21b82f4e
  Jee Jee Li authored Nov 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  21b82f4e
- [CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all... · a736e5ff
  Copilot authored Nov 07, 2025
```
[CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all tests in nightly (#28074)
```
  a736e5ff
- [Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256) · 9da9208b
  baonudesifeizhai authored Nov 07, 2025
  
  9da9208b
- [amd][gptoss] Perf gain because of block alignment (#28024) · 11fd69dd
  smit kadvani authored Nov 06, 2025
```
Signed-off-by: Smit Kadvani <smit.kadvani@gmail.com>
Co-authored-by: Smit Shaileshbhai Kadvani <kadvani@meta.com>
```
  11fd69dd
- Fix issues from #28242 (#28257) · c0a4b95d
  Harry Mellor authored Nov 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c0a4b95d
- Add runai model streamer e2e test for GCS (#28079) · a47d94f1
  Alexis MacAskill authored Nov 06, 2025
```
Signed-off-by: Alexis MacAskill <amacaskill@google.com>
```
  a47d94f1
- [CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) · e70fbc59
  Alex Brooks authored Nov 06, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e70fbc59
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 19 commits
- Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483) · 59b453ea
  Junhong Liu authored Nov 07, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
```
  59b453ea
- Fix failing test for CRadio (#27738) · 827e4237
  Eugene Khvedchenya authored Nov 07, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  827e4237
- [BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d
  Varun Sundar Rabindranath authored Nov 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  ca6f755d
- [Test] Add non-MoE DP test coverage (#28235) · ca90f503
  Matthew Bonanni authored Nov 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  ca90f503
- [Doc]: Make extraInit containers fully configurable in helm chart (#27497) · da855b42
  Fang Han authored Nov 06, 2025
```
Signed-off-by: Fang Han <fhan0520@gmail.com>
```
  da855b42
- [ROCm] triton fp8 kernel (#27058) · 449de900
  Aleksandr Malyshev authored Nov 06, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  449de900
- [Chore] eliminate duplicated and unconditional object serialization in... · d4aa65c9
  Vico Chu authored Nov 07, 2025
```
[Chore] eliminate duplicated and unconditional object serialization in anthropic messages api (#27792)
Signed-off-by: Vico Chu <vico24826@gmail.com>
```
  d4aa65c9
- Add llama 4 scaling support (#28145) · 7a8375f8
  Julien Denize authored Nov 06, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  7a8375f8
- [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) · 5e0c1fe6
  Andy Lo authored Nov 06, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  5e0c1fe6
- CODEOWNERS: Add myself as reviewer on security docs (#28216) · 4507a6da
  Russell Bryant authored Nov 06, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4507a6da
- [Frontend] Fix logging format when enable response logging (#28049) · d1dd5f53
  Roy Wang authored Nov 07, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  d1dd5f53
- [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) · e52e4da9
  StanHatko authored Nov 06, 2025
```
Signed-off-by: Stan Hatko <stan_hatko@live.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e52e4da9
- [Doc] Add Arm CPUs are on the list of supported targets in vLLM (#26018) · 2176778c
  Milos Puzovic authored Nov 06, 2025
```
Signed-off-by: Milos Puzovic <milos.puzovic@arm.com>
```
  2176778c
- [Kernel][Model] Tune fused_moe Triton configs for MiniMax-M2 on H100 (#28200) · 0370679c
  Eric Yue authored Nov 06, 2025
```
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  0370679c
- [Docs] Switch to directory style URLs (#28058) · 8816e375
  Harry Mellor authored Nov 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8816e375
- Disable nm-testing models with issues in CI (#28206) · f3222929
  Michael Goin authored Nov 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f3222929
- [CPU]Improve cpu fused moe perf (#27244) · c757a15f
  xiangze-arm authored Nov 06, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  c757a15f
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
- [Bugfix][Kernel] fix merge attn states when both prefix and suffix are empty (#28181) · 981cadb3
  courage17340 authored Nov 06, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  981cadb3