Commits · c2e6f453cc93a410f1d1d4607f7eb0ee3418bc88 · OpenDAS / vllm_cscc

24 Oct, 2025 1 commit

add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD · c2e6f453

zhuwenwen authored Oct 24, 2025

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

c2e6f453

16 Sep, 2025 1 commit
- [fix]fix tests of engine · 0f8a9861
  zhuwenwen authored Sep 16, 2025
  
  0f8a9861
08 Sep, 2025 1 commit
- update op.moe_fused_gate · bc9aee38
  zhuwenwen authored Sep 08, 2025
  
  bc9aee38
07 Sep, 2025 1 commit
- add VLLM_USE_LIGHT_OP to optimize moe_align_block_size and moe_fused_gate · a54ab95d
  zhuwenwen authored Sep 07, 2025
  
  a54ab95d
06 Sep, 2025 1 commit
- [fix]fix tests of neuron, quantization etc · dc2aff4c
  zhuwenwen authored Sep 06, 2025
  
  dc2aff4c
05 Sep, 2025 1 commit
- [fix]fix tests of core, samplers and tokenization etc. · d3473ba4
  zhuwenwen authored Sep 05, 2025
  
  d3473ba4
04 Sep, 2025 1 commit
- [fix]fix tests of async_engine and compile · 22d7e7c4
  zhuwenwen authored Sep 04, 2025
  
  22d7e7c4
03 Sep, 2025 1 commit
- [fix]fix tests of v1 and worker · a7668e46
  zhuwenwen authored Sep 03, 2025
  
  a7668e46
01 Sep, 2025 1 commit
- [fix]fix tests of fused_moe · 58bbb720
  zhuwenwen authored Sep 01, 2025
  
  58bbb720
26 Aug, 2025 1 commit
- [fix]fix tests of kernels · 31584b45
  zhuwenwen authored Aug 26, 2025
  
  31584b45
01 Aug, 2025 1 commit
- [Model] Add step3 vl · 53ffe40e
  zhuwenwen authored Aug 01, 2025
  
  53ffe40e
29 Jul, 2025 2 commits
- fix: 修复W8A8读config路径错误，删除int8_utils.py文件 · 7e5fb6fe
  jujl1 authored Jul 29, 2025
  
  7e5fb6fe
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
25 Jul, 2025 1 commit
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54
06 Jul, 2025 6 commits
- Revert "[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)" · a5dd03c1
  simon-mo authored Jul 06, 2025
```
This reverts commit e202dd27.
```
  a5dd03c1
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
- test_attention compat with coming xformers change (#20487) · c5ebe040
  Jeremy Reizenstein authored Jul 06, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c5ebe040
05 Jul, 2025 2 commits
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8
04 Jul, 2025 7 commits
- [CI Bugfix] Fix pre-commit failures on main (#20502) · c108781c
  Michael Goin authored Jul 05, 2025
  
  c108781c
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
  Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  4a98edff
03 Jul, 2025 8 commits
- [Bugfix] Register reducer even if transformers_modules not available (#19510) · 8d1096e7
  Seiji Eicher authored Jul 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  8d1096e7
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Tests] Update online DP tests to verify that requests are balanced (#20157) · 67d25eca
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67d25eca
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
- [Misc] Small: Fix video loader return type annotations. (#20389) · b616f6a5
  Chenheli Hua authored Jul 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  b616f6a5
02 Jul, 2025 3 commits

[DP] Support external DP Load Balancer mode (#19790) · 657f2f30
Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
657f2f30
[Minor] Clean up incorrect comment in test (#20382) · d265414d
Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
d265414d

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c