Commits · a4511e38db375a85b4dd784c2c38528747288f46 · OpenDAS / vllm_cscc · GitLab

19 Nov, 2025 14 commits
- Speed up macOS smoke test (#28954) · a4511e38
  Michael Goin authored Nov 19, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a4511e38
- [Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c
  Roman Solomatin authored Nov 19, 2025
```
Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  71d0ae1c
- [Model][QwenVL] Simplify cos/sin rotary embedding indexing (#28962) · 3d4e7d34
  Lukas Geiger authored Nov 19, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3d4e7d34
- [Docs] Update oneshot imports (#28188) · 6a25ea5f
  Uranus authored Nov 19, 2025
```
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
```
  6a25ea5f
- [Bugfix] Fix typo in Qwen3 Next model executor (#28960) · 73ff872d
  Gleb Kurchanov authored Nov 19, 2025
```
Signed-off-by: Gleb Kurchanov <nepherpitou@gmail.com>
```
  73ff872d
- [Bugfix] Fix FusedMoEModularKernel for triton backend (#28913) · 468a8d72
  Xin Yang authored Nov 18, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  468a8d72
- [Attention] FlashAttention ViT support, make default backend (#28763) · 4c23690f
  Matthew Bonanni authored Nov 18, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4c23690f
- Enable bitsandbytes quantization on AMD GPUs that use warp size 32 (#27307) · 814843e0
  Strahinja Stamenkovic authored Nov 19, 2025
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
  814843e0
- [CPU] Refactor CPU WNA16 (#28826) · 20852c8f
  Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  20852c8f
- [Core] Switch Flat logprob control from environment variable to SamplingParams (#28914) · 40b6b38f
  Jialin Ouyang authored Nov 18, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  40b6b38f
- Move online quantization to `model.load_weights` (#26327) · da94c7c0
  Jerry Zhang authored Nov 18, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  da94c7c0
- [Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear... · 1395461f
  tomeras91 authored Nov 19, 2025
```
[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  1395461f
- [Build] Add OpenAI triton_kernels (#28788) · 9912b8cc
  Varun Sundar Rabindranath authored Nov 18, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  9912b8cc
- [NVIDIA] Guard SM100 CUTLASS MoE macro to SM100 builds v2 (#28938) · 49ef847a
  Johnny authored Nov 19, 2025
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
  49ef847a
18 Nov, 2025 25 commits
- Supress verbose logs from model_hosting_container_standards (#28949) · 67745d18
  Michael Goin authored Nov 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67745d18
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
- [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) · c3e29786
  Chendi.Xue authored Nov 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  c3e29786
- [Models] Replace all `nn.Conv2d` with vLLM's Conv2dLayer (#28842) · e4bb2684
  Isotr0py authored Nov 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e4bb2684
- [chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78
  Kevin H. Luu authored Nov 18, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c64c0b78
- [FEAT] [AITER] [ROCm] integrate aiter sampling ops (#26084) · 0af3d4f0
  vllmellm authored Nov 19, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0af3d4f0
- [Minor] Rename `ec_producer` field to `is_ec_producer` (#28884) · da8dadf6
  Nick Hill authored Nov 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da8dadf6
- [CI][NIXL] Change default `block_size` for tests (#28927) · f226a3f0
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f226a3f0
- [Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371
  Luciano Martins authored Nov 18, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c2612371
- [Benchmark] multi_turn: Report warmup-inclusive runtime (#28937) · 49a986ec
  Ido Segev authored Nov 18, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  49a986ec
- [CI Sprint] Quantization CI Cleanup (#24130) · f6aa1226
  Alex authored Nov 18, 2025
```
Signed-off-by: Alex Yun <alexyun04@gmail.com>
```
  f6aa1226
- [Bugfix][NIXL] Fix `block_size_ratio` when logical !=physical blocks (#28925) · 184b12fd
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  184b12fd
- [Model][Perf] Use cos and sin cache in QwenVL (#28798) · b9489f51
  Canlin Guo authored Nov 18, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  b9489f51
- [Bugfix] Safeguard against missing backend in AttentionBackendEnum (#28846) · 285eaa42
  Song Zhixin authored Nov 18, 2025
```
Signed-off-by: jesse <szxfml@gmail.com>
Signed-off-by: Song Zhixin <szxfml@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  285eaa42
- [BugFix] Fix PP/async scheduling with pooling models (#28899) · 43936849
  Nick Hill authored Nov 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  43936849
- [CI/Build] Replace wikipedia url with local server ones (#28908) · 896e41ae
  Isotr0py authored Nov 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  896e41ae
- [MISC] Remove format.sh (#28906) · 5bb1da51
  Kuntai Du authored Nov 18, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  5bb1da51
- [CI] Fix async scheduling + spec decoding test flake (#28902) · 5bdd1552
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bdd1552
- [Misc] Remove unnecessary parentheses from log statements (#28897) · 0168f69e
  Ning Xie authored Nov 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  0168f69e
- [Doc]: fix typos in various files (#28863) · 083cf326
  Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  083cf326
- [Bugfix] Fix wrong CLI defaults for dynamic `SchedulerConfig` fields (#28872) · bf9e1e87
  Cyrus Leung authored Nov 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf9e1e87
- [Refactor] Remove Unused Func in Batch Invariant (#28881) · 3ddcf460
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3ddcf460
- [ROCm][Quantization] add apply_vllm_mapper in quark config for models like gpt-oss (#28638) · d0a73620
  xuebwang-amd authored Nov 18, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  d0a73620
- Run macos smoke test workflow on main commit (#28752) · 88ab591f
  Michael Goin authored Nov 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  88ab591f
- [Bugfix] Fix Kimi-K2 tool parser concatenated tool calls parsing (#28831) · b6e04390
  Benjamin Bartels authored Nov 18, 2025
```
Signed-off-by: Thomas Mao <yiyeguhu@gmail.com>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Thomas Mao <yiyeguhu@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  b6e04390
17 Nov, 2025 1 commit
- [Misc] Fix wrong comment in scheduler (#28880) · 552cac95
  Zhuohan Li authored Nov 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  552cac95