Commits · 40b6b38f2c8f8df1dbc145b48df99575f191014f · OpenDAS / vllm_cscc

19 Nov, 2025 5 commits

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914) · 40b6b38f
Jialin Ouyang authored Nov 18, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
40b6b38f
Move online quantization to `model.load_weights` (#26327) · da94c7c0
Jerry Zhang authored Nov 18, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
da94c7c0

[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear... · 1395461f

tomeras91 authored Nov 19, 2025


[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>

1395461f

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc

[NVIDIA] Guard SM100 CUTLASS MoE macro to SM100 builds v2 (#28938) · 49ef847a
Johnny authored Nov 19, 2025
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
49ef847a

18 Nov, 2025 25 commits
- Supress verbose logs from model_hosting_container_standards (#28949) · 67745d18
  Michael Goin authored Nov 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67745d18
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
- [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) · c3e29786
  Chendi.Xue authored Nov 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  c3e29786
- [Models] Replace all `nn.Conv2d` with vLLM's Conv2dLayer (#28842) · e4bb2684
  Isotr0py authored Nov 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e4bb2684
- [chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78
  Kevin H. Luu authored Nov 18, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c64c0b78
- [FEAT] [AITER] [ROCm] integrate aiter sampling ops (#26084) · 0af3d4f0
  vllmellm authored Nov 19, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0af3d4f0
- [Minor] Rename `ec_producer` field to `is_ec_producer` (#28884) · da8dadf6
  Nick Hill authored Nov 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da8dadf6
- [CI][NIXL] Change default `block_size` for tests (#28927) · f226a3f0
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f226a3f0
- [Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371
  Luciano Martins authored Nov 18, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c2612371
- [Benchmark] multi_turn: Report warmup-inclusive runtime (#28937) · 49a986ec
  Ido Segev authored Nov 18, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  49a986ec
- [CI Sprint] Quantization CI Cleanup (#24130) · f6aa1226
  Alex authored Nov 18, 2025
```
Signed-off-by: Alex Yun <alexyun04@gmail.com>
```
  f6aa1226
- [Bugfix][NIXL] Fix `block_size_ratio` when logical !=physical blocks (#28925) · 184b12fd
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  184b12fd
- [Model][Perf] Use cos and sin cache in QwenVL (#28798) · b9489f51
  Canlin Guo authored Nov 18, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  b9489f51
- [Bugfix] Safeguard against missing backend in AttentionBackendEnum (#28846) · 285eaa42
  Song Zhixin authored Nov 18, 2025
```
Signed-off-by: jesse <szxfml@gmail.com>
Signed-off-by: Song Zhixin <szxfml@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  285eaa42
- [BugFix] Fix PP/async scheduling with pooling models (#28899) · 43936849
  Nick Hill authored Nov 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  43936849
- [CI/Build] Replace wikipedia url with local server ones (#28908) · 896e41ae
  Isotr0py authored Nov 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  896e41ae
- [MISC] Remove format.sh (#28906) · 5bb1da51
  Kuntai Du authored Nov 18, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  5bb1da51
- [CI] Fix async scheduling + spec decoding test flake (#28902) · 5bdd1552
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bdd1552
- [Misc] Remove unnecessary parentheses from log statements (#28897) · 0168f69e
  Ning Xie authored Nov 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  0168f69e
- [Doc]: fix typos in various files (#28863) · 083cf326
  Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  083cf326
- [Bugfix] Fix wrong CLI defaults for dynamic `SchedulerConfig` fields (#28872) · bf9e1e87
  Cyrus Leung authored Nov 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf9e1e87
- [Refactor] Remove Unused Func in Batch Invariant (#28881) · 3ddcf460
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3ddcf460
- [ROCm][Quantization] add apply_vllm_mapper in quark config for models like gpt-oss (#28638) · d0a73620
  xuebwang-amd authored Nov 18, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  d0a73620
- Run macos smoke test workflow on main commit (#28752) · 88ab591f
  Michael Goin authored Nov 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  88ab591f
- [Bugfix] Fix Kimi-K2 tool parser concatenated tool calls parsing (#28831) · b6e04390
  Benjamin Bartels authored Nov 18, 2025
```
Signed-off-by: Thomas Mao <yiyeguhu@gmail.com>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Thomas Mao <yiyeguhu@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  b6e04390
17 Nov, 2025 10 commits
- [Misc] Fix wrong comment in scheduler (#28880) · 552cac95
  Zhuohan Li authored Nov 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  552cac95
- [BugFix] Corner case that could cause out-of-sync with external launcher mode and dp >1 (#28774) · 61485844
  Bangsheng Tang authored Nov 17, 2025
  
  61485844
- [Model] Add Afmoe architecture implementation (#28332) · f77bce00
  Pranav authored Nov 17, 2025
```
Signed-off-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
Signed-off-by: Pranav <veldurthipranav@gmail.com>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
```
  f77bce00
- [Test] Batch Invariant: Rename and organize tests (#27421) · a289cc1d
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a289cc1d
- [Quantization] [Eagle] Add complete quantization support to the draft model in Eagle (#28435) · 95ae50b7
  Shreyas Kulkarni authored Nov 17, 2025
```
Signed-off-by: Shreyas Kulkarni <shreyas.gp269@gmail.com>
```
  95ae50b7
- [BugFix] Fix PP performance and PP kv connector output regression (#28768) · 7765e5ba
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7765e5ba
- [Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61
  Ronald authored Nov 18, 2025
```
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  d8874c61
- [Bugfix] Fix GPT-OSS on AMD after #28603 (#28816) · f8b19c0f
  Zhewen Li authored Nov 17, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  f8b19c0f
- Cast return value to int64_t for cache size (#28814) · e42bd8c2
  tiehexue authored Nov 18, 2025
```
Signed-off-by: tiehexue <tiehexue@hotmail.com>
```
  e42bd8c2
- [Bugfix][Perf] Revert applying HF processor on text-only inputs for multimodal models (#28858) · 7f064491
  Roger Wang authored Nov 17, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  7f064491