Commits · ec152c8748d0b37da157fa6a99a75920822dc30d · OpenDAS / vllm_cscc · GitLab

27 Sep, 2025 17 commits
- Fix GPTQ model loading in Transformers backend (#25770) · ec152c87
  Harry Mellor authored Sep 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ec152c87
- Add filtering for chat template kwargs (#25794) · 7977e502
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7977e502
- Validate API tokens in constant time (#25781) · 3f5d902d
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
```
  3f5d902d
- [Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27d7638b
- [Bugfix] Add missing `image_size` for phi4_multimodal (#25796) · 17617398
  Xiaohan Zou authored Sep 27, 2025
  
  17617398
- [Misc] Update openai client example file for multimodal (#25795) · 23b8ee67
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  23b8ee67
- [Misc] Fix codeowners override for v1 sample and attention (#25037) · 39391520
  22quinn authored Sep 27, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  39391520
- [CI/Build] Reorganize root-level V1 tests (#25767) · cd87bfbf
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd87bfbf
- [CI/Build] Add timing to Model Executor Test (#25799) · b3613e3a
  22quinn authored Sep 26, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b3613e3a
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- [Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788) · c242c980
  Wentao Ye authored Sep 26, 2025
  
  c242c980
- [Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15
  WeiQing Chen authored Sep 27, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
```
  f1d53d15
- Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782) · 92da847c
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  92da847c
- Add option to restrict media domains (#25783) · 3958b96b
  Russell Bryant authored Sep 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
```
  3958b96b
- [Core] Don't count preempted tokens in prefix cache hit rate (#25787) · 8bf8f458
  Zhuohan Li authored Sep 26, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  8bf8f458
- [Spec decode] automatically disable mm for text-only draft models (#25667) · 6f5c0931
  Jonas M. Kübler authored Sep 27, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  6f5c0931
- [Bugfix] Optimize CpuGpuBuffer initialization (#25447) · 4e33a7ea
  Naman Lalit authored Sep 26, 2025
```
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  4e33a7ea
26 Sep, 2025 23 commits
- Kernel-override Determinism [1/n] (#25603) · dc48ba0c
  Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  dc48ba0c
- Reduce the Cuda Graph memory footprint when running with DBO (#25779) · 4778b426
  Sage Moore authored Sep 26, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  4778b426
- [spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
  qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  c70ac4b8
- [CI] Fix FlashInfer AOT in release docker image (#25730) · cf892028
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cf892028
- [V1] address post issues related to #20059 (part 1) (#23046) · f075693d
  fhl2000 authored Sep 27, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  f075693d
- [CI] Add E2E Blackwell Quantized MoE Test (#25723) · f708bd49
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f708bd49
- [Docs] Add Toronto Meetup (#25773) · 0002b7f0
  Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0002b7f0
- [Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355) · 11aafd98
  Frank Wang authored Sep 26, 2025
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  11aafd98
- [Doc]: improve CPU(x86) build-wheel-from-source section (#25617) · b761df96
  Clouddude authored Sep 26, 2025
```
Signed-off-by: Kosseila (CloudThrill) <klouddude@gmail.com>
```
  b761df96
- Eagle3 that supports the Minicpm3 model (#24243) · 33f6aaf9
  阿丹(adan) authored Sep 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: liudan <adan@minicpm.com>
Co-authored-by: liudan <liudan@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
```
  33f6aaf9
- [Misc] fix unique_filepath (#25732) · 56aafa8c
  Jiangyun Zhu authored Sep 27, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  56aafa8c
- [ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439) · 8d52f2b3
  Seiji Eicher authored Sep 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
```
  8d52f2b3
- [BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring... · 984d1849
  Lucas Wilkinson authored Sep 26, 2025
```
[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  984d1849
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
- [CI/Build] Fix some V1 tests not being run (#25569) · db1e42f6
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db1e42f6
- [CI/Build] Split up Distributed Tests (#25572) · bc9d7b55
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bc9d7b55
- [Bugfix] Properly abort pooling request. (#25734) · fe6b19c3
  wang.yuqi authored Sep 26, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  fe6b19c3
- [CI] Fix test_shared_storage_connector_hashes (#25748) · 2827b3f4
  Chauncey authored Sep 26, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2827b3f4
- [Model] Mamba2 varlen refactor (#21467) · 2b6b1d78
  Chih-Chieh Yang authored Sep 26, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: RishiAstra <40644327+RishiAstra@users.noreply.github.com>
```
  2b6b1d78
- [Doc] Update Batch-level DP docs (#25757) · 633f943e
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  633f943e
- Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
  Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  b03b1b97
- [Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698) · dfb9af20
  Sage Moore authored Sep 26, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  dfb9af20
- [misc] refactor speculative config (#25657) · 19f76ee6
  yyzxw authored Sep 26, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  19f76ee6