Commits · 9b44a7d9265b78c7b72c20e0698ede17d62de5e8 · OpenDAS / vllm_cscc

"tests/entrypoints/pooling/basic/__init__.py" did not exist on "376725ce74d2d75490eed1840b41de00c0e4acd6"

29 Sep, 2025 2 commits

Robert Shaw authored Sep 29, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

9b44a7d9

[Misc] fix tests failure by using current_platform (#25825) · a3ae45a3
Juechen Liu authored Sep 28, 2025
```
Signed-off-by: Juechen Liu <jueliu@meta.com>
```
a3ae45a3

28 Sep, 2025 7 commits
- Remove redundant cudagraph dispatcher warning (#25841) · 0307428d
  Michael Goin authored Sep 28, 2025
  
  0307428d
- [Bugfix] fix Qwen3VLMoe load when pp > 1 (#25838) · 471997ad
  JJJYmmm authored Sep 29, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  471997ad
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
- Fix random dataset mismatched token length with config. (#24937) · f4e4088c
  weiliang authored Sep 28, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f4e4088c
- [VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 0efd540d
  Isotr0py authored Sep 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  0efd540d
- [Bugfix] Fix Qwen3-VL regression from #24982 (#25814) · 61447540
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  61447540
- [MM] Optimize memory profiling for scattered multimodal embeddings (#25810) · 69311446
  Roger Wang authored Sep 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  69311446
27 Sep, 2025 19 commits
- [Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808) · da63274d
  Nicolò Lucchesi authored Sep 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da63274d
- [Core] GC Debug callback (#24829) · c216119d
  Jialin Ouyang authored Sep 27, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>
```
  c216119d
- [torch.compile]: Add VLLM_DEBUG_DUMP_PATH environment variable (#25651) · c0ec8183
  Jiangyun Zhu authored Sep 28, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  c0ec8183
- [Core] Refactor self.model() to call a helper for subclassing. (#25084) · b65e56ba
  Patrick C. Toulme authored Sep 27, 2025
```
Signed-off-by: Patrick Toulme <ptoulme@meta.com>
Signed-off-by: Patrick Toulme <pctoulme+1@gmail.com>
```
  b65e56ba
- [env] default nixl side port conflicts with kv-event zmq port (#25056) · 49996cd5
  Peter Pan authored Sep 27, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  49996cd5
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
- [Bugfix] Fix triton import precommit failure (#25803) · f9df8b4a
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f9df8b4a
- Fix GPTQ model loading in Transformers backend (#25770) · ec152c87
  Harry Mellor authored Sep 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ec152c87
- Add filtering for chat template kwargs (#25794) · 7977e502
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7977e502
- Validate API tokens in constant time (#25781) · 3f5d902d
  Russell Bryant authored Sep 27, 2025
```
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
```
  3f5d902d
- [Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27d7638b
- [Bugfix] Add missing `image_size` for phi4_multimodal (#25796) · 17617398
  Xiaohan Zou authored Sep 27, 2025
  
  17617398
- [CI/Build] Consolidate model loader tests and requirements (#25765) · d346ec69
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d346ec69
- [Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788) · c242c980
  Wentao Ye authored Sep 26, 2025
  
  c242c980
- [Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15
  WeiQing Chen authored Sep 27, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
```
  f1d53d15
- Add option to restrict media domains (#25783) · 3958b96b
  Russell Bryant authored Sep 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
```
  3958b96b
- [Core] Don't count preempted tokens in prefix cache hit rate (#25787) · 8bf8f458
  Zhuohan Li authored Sep 26, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  8bf8f458
- [Spec decode] automatically disable mm for text-only draft models (#25667) · 6f5c0931
  Jonas M. Kübler authored Sep 27, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  6f5c0931
- [Bugfix] Optimize CpuGpuBuffer initialization (#25447) · 4e33a7ea
  Naman Lalit authored Sep 26, 2025
```
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  4e33a7ea
26 Sep, 2025 12 commits

Kernel-override Determinism [1/n] (#25603) · dc48ba0c
Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
dc48ba0c
Reduce the Cuda Graph memory footprint when running with DBO (#25779) · 4778b426
Sage Moore authored Sep 26, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
4778b426
[spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
c70ac4b8

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

[CI] Add E2E Blackwell Quantized MoE Test (#25723) · f708bd49
Michael Goin authored Sep 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f708bd49

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355) · 11aafd98

Frank Wang authored Sep 26, 2025

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

11aafd98

Eagle3 that supports the Minicpm3 model (#24243) · 33f6aaf9

阿丹(adan) authored Sep 27, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: liudan <adan@minicpm.com>
Co-authored-by: liudan <liudan@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>

33f6aaf9

[Misc] fix unique_filepath (#25732) · 56aafa8c

Jiangyun Zhu authored Sep 27, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439) · 8d52f2b3

Seiji Eicher authored Sep 26, 2025

Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>

8d52f2b3

[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring... · 984d1849

Lucas Wilkinson authored Sep 26, 2025


[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

984d1849

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d4d98998

[Bugfix] Properly abort pooling request. (#25734) · fe6b19c3

wang.yuqi authored Sep 26, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

fe6b19c3