Commits · 99324e255d5f7f4fb75a858ca9f8f3ed1f946b46 · OpenDAS / vllm_cscc · GitLab

12 Jul, 2025 1 commit
- Merge tag 'v0.9.2' into v0.9.2-ori · 99324e25
  zhuwenwen authored Jul 12, 2025
  
  99324e25
06 Jul, 2025 14 commits
- Revert "[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)" · a5dd03c1
  simon-mo authored Jul 06, 2025
```
This reverts commit e202dd27.
```
  a5dd03c1
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
- [Misc] call the pre-defined func (#20518) · 43813e63
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  43813e63
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248
- [TPU][Bugfix] fix the MoE OOM issue (#20339) · 4548c03c
  Chengji Yao authored Jul 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  4548c03c
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [Bugfix] Fix missing per_act_token parameter in compressed_tensors_moe (#20509) · 43287082
  Lucia Fang authored Jul 06, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  43287082
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
- test_attention compat with coming xformers change (#20487) · c5ebe040
  Jeremy Reizenstein authored Jul 06, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c5ebe040
- [Misc] remove unused import (#20517) · 8d763cb8
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8d763cb8
05 Jul, 2025 6 commits
- [Misc] Add logger.exception for TPU information collection failures (#20510) · cf4cd539
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  cf4cd539
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8
- [doc] small fix (#20506) · ef9a2990
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  ef9a2990
- [Misc] Add security warning for development mode endpoints (#20508) · 7e908704
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  7e908704
04 Jul, 2025 17 commits
- [Doc] fix mutltimodal_inputs.md gh examples link (#20497) · d3f05c92
  Guy Stone authored Jul 05, 2025
```
Signed-off-by: Guy Stone <guys@spotify.com>
```
  d3f05c92
- [CI Bugfix] Fix pre-commit failures on main (#20502) · c108781c
  Michael Goin authored Jul 05, 2025
  
  c108781c
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- [Misc] Small: Remove global media connector. Each test should have its own... · ffe00ef7
  Chenheli Hua authored Jul 04, 2025
```
[Misc] Small: Remove global media connector. Each test should have its own test connector object. (#20395)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ffe00ef7
- [CI] add kvcache-connector dependency definition and add into CI build (#18193) · 5561681d
  Peter Pan authored Jul 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  5561681d
- [Doc] Fix classification table in list of supported models (#20489) · fbd62d87
  Cyrus Leung authored Jul 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fbd62d87
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
- Support Llama 4 for fused_marlin_moe (#20457) · 0e3fe896
  Michael Goin authored Jul 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0e3fe896
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331) · 783921d8
  Wentao Ye authored Jul 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  783921d8
- [Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
  Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  4a98edff
- [Misc] small update (#20462) · a7bab0c9
  Reid authored Jul 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a7bab0c9
- Add ignore consolidated file in mistral example code (#20420) · 25950dca
  汪志鹏 authored Jul 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  25950dca
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
- [Misc] Change warn_for_unimplemented_methods to debug (#20455) · 7e1665b0
  Michael Goin authored Jul 04, 2025
  
  7e1665b0
03 Jul, 2025 2 commits
- [Bugfix] Register reducer even if transformers_modules not available (#19510) · 8d1096e7
  Seiji Eicher authored Jul 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  8d1096e7
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3