Commits · 54de71d0dfbb6340fdbc620f4ebeb4236d165a37 · OpenDAS / vllm_cscc · GitLab

04 Aug, 2025 5 commits
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
- [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) · 8ecb3e9e
  Tyler Michael Smith authored Aug 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8ecb3e9e
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- [PD] add test for chat completions endpoint (#21925) · 0d7db16a
  Abirdcfly authored Aug 04, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  0d7db16a
03 Aug, 2025 4 commits
- [Bugfix] Fix failing multimodal standard test (#22153) · 6a39ba85
  Isotr0py authored Aug 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6a39ba85
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [Misc] Add tensor schema test coverage for multimodal models (#21754) · 3dddbf1f
  Isotr0py authored Aug 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3dddbf1f
02 Aug, 2025 9 commits
- [Frontend] Improve error message for too many mm items (#22114) · f5d0f478
  Cyrus Leung authored Aug 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5d0f478
- [Model] Mamba2 preallocate SSM output tensor to avoid d2d copy overhead (#21075) · b690e348
  Chih-Chieh Yang authored Aug 02, 2025
```
Signed-off-by: Chih-Chieh Yang <7364402+cyang49@users.noreply.github.com>
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  b690e348
- for glm-4.1V update (#22000) · 25373b6c
  Yuxuan Zhang authored Aug 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  25373b6c
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
- Fix test_kv_sharing_fast_prefill flakiness (#22038) · 8564dc94
  Yong Hoon Shin authored Aug 01, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8564dc94
- [Misc] Getting and passing ray runtime_env to workers (#22040) · 4ac84373
  Rui Qiao authored Aug 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  4ac84373
- [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) · 0edaf752
  Sage Moore authored Aug 01, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0edaf752
- [Test] Add Unit Test for Batched DeepGEMM (#21559) · 6e8d8c4a
  Wentao Ye authored Aug 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6e8d8c4a
- [Speculators][Speculative Decoding] Add Qwen Eagle3 Support (#21835) · 9f9c38c3
  Dipika Sikka authored Aug 01, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  9f9c38c3
01 Aug, 2025 13 commits
- [CI] Initial tests for SM100 Blackwell runner (#21877) · 88faa466
  Michael Goin authored Aug 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  88faa466
- Add lora test for tp>1 case for TPU. (#21970) · d84b97a3
  XiongfeiWei authored Aug 01, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d84b97a3
- Enable headless models for pooling in the Transformers backend (#21767) · 38c8bce8
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  38c8bce8
- [Bugfix] fix when skip tokenizer init (#21922) · b879ecd6
  rongfu.leng authored Aug 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  b879ecd6
- [Bugfix] Fix glm4.1v video inference issue (#22067) · 3f8e9521
  Isotr0py authored Aug 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3f8e9521
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
- feat(multimodal): Add customizable background color for RGBA to RGB conversion (#22052) · 0a6d305e
  Gamhang authored Aug 01, 2025
```
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Co-authored-by: Jinheng Li <ahengljh@gmail.com>
```
  0a6d305e
- Fix `get_kwargs` for case where type hint is `list[Union[str, type]]` (#22016) · fb0e0d46
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb0e0d46
- [Speculative Decoding] Add `speculators` config support (#21345) · dfbc1f88
  Dipika Sikka authored Aug 01, 2025
  
  dfbc1f88
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
- [Bugfix] Fix: Fix multi loras with tp >=2 and LRU cache (#20873) · ad57f23f
  Charent authored Aug 01, 2025
```
Signed-off-by: charent <19562666+charent@users.noreply.github.com>
```
  ad57f23f
- [Refactor] Remove Duplicate `per_block_cast_to_fp8`, Remove Dependencies of DeepGEMM (#21787) · 37006420
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  37006420
- Add DeepGEMM to Dockerfile in vllm-base image (#21533) · e360316a
  Matthew Bonanni authored Jul 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  e360316a
31 Jul, 2025 8 commits
- Add FlashInfer allreduce RMSNorm Quant fusion (#21069) · 6e672daf
  Ilya Markov authored Jul 31, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  6e672daf
- [Misc] Add unit tests for chunked local attention (#21692) · 71470bc4
  Yong Hoon Shin authored Jul 31, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  71470bc4
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [Model] Add step3 vl (#21998) · 94846416
  Song authored Jul 31, 2025
```
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
```
  94846416
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
- [Bugfix]: fix metadata file copy in test_sharded_state_loader (#21830) · 3e36fcbe
  Ning Xie authored Jul 31, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3e36fcbe
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
30 Jul, 2025 1 commit
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3