Commits · d0ceb38ae8b6a96837a51cfa68ce3f1a2fe13a4b · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "c3ce4d7f6ac7d16eeefd4c177bc8dbfbff49f684"

07 Nov, 2025 16 commits
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
- [Log] update shm wait time msg (#28255) · 0f872b79
  Boyuan Feng authored Nov 07, 2025
  
  0f872b79
- [Feature] Default `ignore_eos` True for `random` dataset (#28227) · 4b1ff132
  Wentao Ye authored Nov 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4b1ff132
- [CLI] add --max-tokens to `vllm complete` (#28109) · e0d6b4a8
  Iceber Gu authored Nov 07, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  e0d6b4a8
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
- [fix] Revert "fixing mm placeholder replacement issue with gemma3" (#28285) · 8e19d470
  Kevin H. Luu authored Nov 07, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  8e19d470
- [Misc][Model][Refactor] Pass the prefix into Linear layers (#28259) · 1958bda9
  Mengqing Cao authored Nov 07, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  1958bda9
- [CPU]Avoid repeated random sample compile (#28260) · 7bdb42b2
  Zhang Xiangze authored Nov 07, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  7bdb42b2
- [FixBug]Aeala/ShareGPT_Vicuna_unfiltered marked as multimodal benchmark (#28265) · 315068eb
  汪志鹏 authored Nov 07, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  315068eb
- [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171) · ccd98b59
  Jialin Ouyang authored Nov 07, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ccd98b59
- [Kernel] LoRA triton kernels support PDL (#27402) · 21b82f4e
  Jee Jee Li authored Nov 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  21b82f4e
- [Bug] Fix missing token_ids for reasoning parser models in chat completions #28246 (#28256) · 9da9208b
  baonudesifeizhai authored Nov 07, 2025
  
  9da9208b
- [amd][gptoss] Perf gain because of block alignment (#28024) · 11fd69dd
  smit kadvani authored Nov 06, 2025
```
Signed-off-by: Smit Kadvani <smit.kadvani@gmail.com>
Co-authored-by: Smit Shaileshbhai Kadvani <kadvani@meta.com>
```
  11fd69dd
- Fix issues from #28242 (#28257) · c0a4b95d
  Harry Mellor authored Nov 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c0a4b95d
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 24 commits
- Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483) · 59b453ea
  Junhong Liu authored Nov 07, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
```
  59b453ea
- [BugFix] Fix FusedMoELoRA + ModularKernel Integration (#28237) · ca6f755d
  Varun Sundar Rabindranath authored Nov 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  ca6f755d
- [ROCm] triton fp8 kernel (#27058) · 449de900
  Aleksandr Malyshev authored Nov 06, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  449de900
- [Chore] eliminate duplicated and unconditional object serialization in... · d4aa65c9
  Vico Chu authored Nov 07, 2025
```
[Chore] eliminate duplicated and unconditional object serialization in anthropic messages api (#27792)
Signed-off-by: Vico Chu <vico24826@gmail.com>
```
  d4aa65c9
- Add llama 4 scaling support (#28145) · 7a8375f8
  Julien Denize authored Nov 06, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  7a8375f8
- [Frontend] Fix logging format when enable response logging (#28049) · d1dd5f53
  Roy Wang authored Nov 07, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  d1dd5f53
- [HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953) · e52e4da9
  StanHatko authored Nov 06, 2025
```
Signed-off-by: Stan Hatko <stan_hatko@live.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e52e4da9
- [Kernel][Model] Tune fused_moe Triton configs for MiniMax-M2 on H100 (#28200) · 0370679c
  Eric Yue authored Nov 06, 2025
```
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  0370679c
- [CPU]Improve cpu fused moe perf (#27244) · c757a15f
  xiangze-arm authored Nov 06, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  c757a15f
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
- [V0 deprecation]clean up is_v1_supported_oracle (#28116) · c3ee80a0
  wangxiyuan authored Nov 06, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  c3ee80a0
- [CPU] Enable torch profiling (#28130) · 3755c145
  Aditya Tewari authored Nov 06, 2025
```
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
```
  3755c145
- Fix hard-coded parameter name in gemma3n.py (#27946) · 201dc98a
  Seungduk Kim authored Nov 06, 2025
```
Signed-off-by: Seungduk Kim <seungduk.kim@yanolja.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  201dc98a
- Patch Mistral Tokenizer (#28146) · a404e2c0
  Julien Denize authored Nov 06, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a404e2c0
- [flashinfer] fix FI all2all with FI cutlass moe (#28166) · e31946f8
  Xiaozhu Meng authored Nov 05, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
```
  e31946f8
- Make the cv2 dependency optional (#27780) · d72299d4
  Jacob Zhong authored Nov 06, 2025
```
Signed-off-by: Jacob <cmpute@qq.com>
```
  d72299d4
- [Core][MM] Use non-blocking CPU-GPU copy of multimodal data (#28141) · 80679f10
  Lukas Geiger authored Nov 06, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  80679f10
- [Chore] Clean up deepseek v2/v3 config copy (#28055) · 43ecd0a9
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  43ecd0a9
- [Misc] Remove the duplicate code (#28111) · 07d61451
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  07d61451
- [Feature] Enable TP + EP `shared_experts` overlap with router, 3.7% E2E... · d71af5f5
  Wentao Ye authored Nov 05, 2025
```
[Feature] Enable TP + EP `shared_experts` overlap with router, 3.7% E2E performance improvement (#28164)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d71af5f5
- [Bug] Fix env string `"0"` same to `True` (#28159) · 90189c71
  Wentao Ye authored Nov 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  90189c71
- [Bug] Fix cpu disable shared_experts `VLLM_DISABLE_SHARED_EXPERTS_STREAM` (#28157) · d79d9f07
  Wentao Ye authored Nov 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d79d9f07
- [PERF] Decouple projections from GDN custom op. Attempt 2 (#28083) · b6a248bd
  Vadim Gimpelson authored Nov 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  b6a248bd
- [Debugging] Add annotation for easier trace analysis (#22496) · 17676585
  Dayeol Lee authored Nov 05, 2025
  
  17676585