Commits · 370661856bcfc4cdc9a88580cb70d66b7ac9fc7c · OpenDAS / vllm_cscc

"vllm/entrypoints/openai/chat_completion/serving.py" did not exist on "76e8a70476ef9daa970349c14c117fe91e8b4544"

07 Aug, 2025 8 commits
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
- [CI] Skip the pooling models that do not support transformers v4.55 (#22411) · 2a4c8255
  wang.yuqi authored Aug 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2a4c8255
- [Bugfix]: Fix the streaming output for function calls in the minimax (#22015) · 5e9455ae
  qscqesze authored Aug 07, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  5e9455ae
- Use float32 for test_completion.py (#22385) · a00d8b23
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  a00d8b23
- [Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b
  Lucas Wilkinson authored Aug 06, 2025
```
[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1dc8a70b
- Support encoder_only attention for FlexAttention (#22273) · f825c6bd
  Maximilien de Bayser authored Aug 06, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  f825c6bd
- [model] Support MiniCPM-V 4.0 (#22166) · 41b67f42
  tc-mb authored Aug 07, 2025
```
Co-authored-by: imning3 <hbning@pku.edu.cn>
```
  41b67f42
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
06 Aug, 2025 4 commits

[Misc] Clean up duplicated hf overrides (#22311) · fa00c5d7
Isotr0py authored Aug 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
fa00c5d7
Add GPT-OSS model code and config [1/N] (#22327) · de98252f
Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
de98252f

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07

[Bugfix] Remove faulty test for oot attention backend (#22286) · 35509fc5
Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
35509fc5

05 Aug, 2025 11 commits
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
- [V0 Deprecation][TPU] Remove V1 flag check from tests (#22248) · 0c275ad5
  Nicolò Lucchesi authored Aug 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0c275ad5
- [NVIDIA] Support Flashinfer TRT-LLM Prefill Attention Kernel (#22095) · 83156c7b
  elvischenv authored Aug 05, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  83156c7b
- [Feature] Non-contiguous Support for FP8 Quantization (#21961) · 4771df7b
  Wentao Ye authored Aug 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4771df7b
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
- [UX] Fail if an invalid attention backend is specified (#22217) · e79a12fc
  Michael Goin authored Aug 05, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  e79a12fc
- self.gate dtype update for GLM-4.5 (#22203) · 6fa41e0c
  Yuxuan Zhang authored Aug 05, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  6fa41e0c
- [V0 deprecation][P/D] Deprecate v0 `KVConnectorBase` code (1/2) (#21785) · f4f4e7ef
  lkchen authored Aug 04, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  f4f4e7ef
- [V1] reduce block size for tree attention correctness test to fix 'ou… (#22207) · 5ea71ff4
  Giancarlo Delfin authored Aug 04, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  5ea71ff4
- Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223) · 71758176
  Woosuk Kwon authored Aug 04, 2025
  
  71758176
- [Bugfix] V1 Fix the cursor leakage issue during request scheduling. (#21173) · 2dffac46
  PiteXChen authored Aug 05, 2025
```
Signed-off-by: CLFutureX <775523362@qq.com>
```
  2dffac46
04 Aug, 2025 6 commits
- Fix Arcee model weight loading: Add custom load_weights (#21725) · a5fff3bd
  Raghav Ravishankar authored Aug 04, 2025
```
Signed-off-by: alyosha-swamy <raghav@arcee.ai>
```
  a5fff3bd
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
- [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) · 8ecb3e9e
  Tyler Michael Smith authored Aug 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8ecb3e9e
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- [PD] add test for chat completions endpoint (#21925) · 0d7db16a
  Abirdcfly authored Aug 04, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  0d7db16a
03 Aug, 2025 4 commits
- [Bugfix] Fix failing multimodal standard test (#22153) · 6a39ba85
  Isotr0py authored Aug 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6a39ba85
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [Misc] Add tensor schema test coverage for multimodal models (#21754) · 3dddbf1f
  Isotr0py authored Aug 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3dddbf1f
02 Aug, 2025 7 commits
- [Frontend] Improve error message for too many mm items (#22114) · f5d0f478
  Cyrus Leung authored Aug 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5d0f478
- [Model] Mamba2 preallocate SSM output tensor to avoid d2d copy overhead (#21075) · b690e348
  Chih-Chieh Yang authored Aug 02, 2025
```
Signed-off-by: Chih-Chieh Yang <7364402+cyang49@users.noreply.github.com>
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  b690e348
- for glm-4.1V update (#22000) · 25373b6c
  Yuxuan Zhang authored Aug 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  25373b6c
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
- Fix test_kv_sharing_fast_prefill flakiness (#22038) · 8564dc94
  Yong Hoon Shin authored Aug 01, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8564dc94
- [Misc] Getting and passing ray runtime_env to workers (#22040) · 4ac84373
  Rui Qiao authored Aug 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  4ac84373
- [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) · 0edaf752
  Sage Moore authored Aug 01, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0edaf752