Commits · 811ac13d039648f2d78a636ce4366e70449380c8 · OpenDAS / vllm_cscc

"examples/backends/trtllm/deploy/agg.yaml" did not exist on "ee3a8e42838108a92d813b1a21037ad69e4d1530"

05 Aug, 2025 16 commits
- [Core] Factor out common logic for MM budget calculation (#22228) · 811ac13d
  Cyrus Leung authored Aug 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  811ac13d
- [UX] Fail if an invalid attention backend is specified (#22217) · e79a12fc
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  e79a12fc
- [Bugfix] Misaligned params in TreeAttentionImpl (#22226) · cdfd6871
  Cyrus Leung authored Aug 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cdfd6871
- Optimize configuration access with LRU cache in custom ops (#22204) · 4b3e4474
  ZiTian.Zhao authored Aug 05, 2025
```
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
```
  4b3e4474
- [Misc] log more detailed message for ensure_model_parallel_initialized (#22144) · bd3db7f4
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  bd3db7f4
- [Doc] add backend to doc string of initialize_model_parallel (#22142) · 29b97c09
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  29b97c09
- [Misc] Remove pass_config from CompilationConfig dump_json excluded (#21911) · 7b455cf1
  elvischenv authored Aug 05, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  7b455cf1
- fix: kimi_k2 return empty tool call list (#22149) · 8a6e108e
  tlipoca9 authored Aug 05, 2025
```
Signed-off-by: tlipoca9 <tlipoca9@gmail.com>
```
  8a6e108e
- [Log] DeepGEMM Update Log for Unaligned Problem Size (#22208) · d7b28f34
  Wentao Ye authored Aug 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d7b28f34
- self.gate dtype update for GLM-4.5 (#22203) · 6fa41e0c
  Yuxuan Zhang authored Aug 05, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  6fa41e0c
- [ROCm][Bugfix] Compilation passes fix (#22202) · 031ca762
  Gregory Shtrasberg authored Aug 04, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  031ca762
- [FEAT] Refactor ROPE into module (#22192) · 6ad6b8e1
  TJian authored Aug 04, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  6ad6b8e1
- [V0 deprecation][P/D] Deprecate v0 `KVConnectorBase` code (1/2) (#21785) · f4f4e7ef
  lkchen authored Aug 04, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  f4f4e7ef
- Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223) · 71758176
  Woosuk Kwon authored Aug 04, 2025
  
  71758176
- [Bugfix] V1 Fix the cursor leakage issue during request scheduling. (#21173) · 2dffac46
  PiteXChen authored Aug 05, 2025
```
Signed-off-by: CLFutureX <775523362@qq.com>
```
  2dffac46
- [NVIDIA] Auto detect modelopt quant and fix DSR1-FP4 weight loading (#22073) · bdcb42e4
  Po-Han Huang (NVIDIA) authored Aug 05, 2025
  
  bdcb42e4
04 Aug, 2025 12 commits
- [Responses API] Ignore `store=True` and process the request by default (#22185) · 9af654cc
  Woosuk Kwon authored Aug 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9af654cc
- Fix Arcee model weight loading: Add custom load_weights (#21725) · a5fff3bd
  Raghav Ravishankar authored Aug 04, 2025
```
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
```
  a5fff3bd
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [Bugfix] Fix failing GGUF models test (#22174) · fed5849d
  Isotr0py authored Aug 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fed5849d
- [feat] move WEIGHT_SCALE_SUPPORTED into raise block to accelerate RLHF weight loading (#21164) · c1b4eb04
  Weixiao Huang authored Aug 04, 2025
```
Signed-off-by: huangweixiao <huangweixiao@msh.team>
```
  c1b4eb04
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
- Remove index_put from MM embeddings merging (#22105) · e5949e5a
  Chenxi Yang authored Aug 03, 2025
```
Co-authored-by: Chenxi Yang <cxyang@meta.com>
```
  e5949e5a
- [refactor] improve ConstantList exception specificity (#22156) · 49bcd893
  ZiTian.Zhao authored Aug 04, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  49bcd893
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- remove duplicate code within cleanup_dist_env_and_memory (#22147) · c2e75b3c
  Ning Xie authored Aug 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c2e75b3c
- [fix] fix correct assertion syntax error in attention utils. (#22154) · e27d25a0
  ZiTian.Zhao authored Aug 04, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  e27d25a0
- Use `aiohttp` connection pool for benchmarking (#21981) · 6f547829
  Seiji Eicher authored Aug 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  6f547829
03 Aug, 2025 9 commits
- fuse fp32 for GLM-4.5 e_score_correction_bias (#22143) · d3c18c9c
  Yuxuan Zhang authored Aug 04, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  d3c18c9c
- [CI/Build][Bugfix] Fix Qwen2.5 tests in CPU CI via fallback silu_and_mul to... · b5dfb94f
  Li, Jiang authored Aug 03, 2025
```
[CI/Build][Bugfix] Fix Qwen2.5 tests in CPU CI via fallback silu_and_mul to torch native implementation (#22145)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b5dfb94f
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [executor] feat: add supports_pp attr to executors (#21786) · 24d1dffb
  H authored Aug 03, 2025
```
Signed-off-by: Haibin Lin <haibin.lin@bytedance.com>
```
  24d1dffb
- [Misc] update doc comment for send (#22026) · 7de45db9
  Ning Xie authored Aug 03, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  7de45db9
- [Benchmark] Support ready check timeout in `vllm bench serve` (#21696) · 3f36c325
  Ye (Charlotte) Qi authored Aug 03, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  3f36c325
- [Misc] Add tensor schema test coverage for multimodal models (#21754) · 3dddbf1f
  Isotr0py authored Aug 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3dddbf1f
- [Fix] Fix llama4 modelopt weight loading error (#22107) · 337eb23b
  jiahanc authored Aug 03, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  337eb23b
02 Aug, 2025 3 commits
- Revert "[compile][startup] Disable C++ compilation of symbolic shapes" (#22122) · 554df8a6
  Xiao authored Aug 02, 2025
```
Signed-off-by: Xiao Liu <xiszishu@gmail.com>
```
  554df8a6
- [xpu]support moe models on XPU platform (#21643) · 73e1b9b1
  Yan Ma authored Aug 02, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  73e1b9b1
- [V1] [Hybrid] Validate compatibility of attention backend batch reordering at init time (#21557) · 4abfd879
  Thomas Parnell authored Aug 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  4abfd879