Commits · a8c6fcf65bfb2c64114e70285c4c3efe425382e6 · OpenDAS / vllm_cscc

01 Aug, 2025 2 commits
- [Model] Update step3 vl · 66540380
  zhuwenwen authored Aug 01, 2025
  
  66540380
- [Model] Add step3 vl · 53ffe40e
  zhuwenwen authored Aug 01, 2025
  
  53ffe40e
31 Jul, 2025 3 commits
- update mlp · 741dbbbb
  zhuwenwen authored Jul 31, 2025
  
  741dbbbb
- 去除多余的w4a8参数 · 961cce86
  gaoqiong authored Jul 31, 2025
  
  961cce86
- 增加fused moe文件中w4a8的相关修改 · f5a7f12c
  gaoqiong authored Jul 31, 2025
  
  f5a7f12c
30 Jul, 2025 1 commit
- 解决v1cudagraph的问题以及接入fuse moe marlin_V3版本 · 9820d063
  yangql authored Jul 30, 2025
  
  9820d063
29 Jul, 2025 2 commits
- fix: 修复W8A8读config路径错误，删除int8_utils.py文件 · 7e5fb6fe
  jujl1 authored Jul 29, 2025
  
  7e5fb6fe
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
28 Jul, 2025 2 commits
- fix: 修复W8A8INT8读config问题 · c6187ade
  jujl1 authored Jul 28, 2025
  
  c6187ade
- 修改W4A8 以及W8A8量化量化092接口 · 7017f30c
  gaoqiong authored Jul 28, 2025
  
  7017f30c
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
25 Jul, 2025 2 commits
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54
24 Jul, 2025 1 commit
- add fused_experts_impl of int8 · 41e6d686
  zhuwenwen authored Jul 24, 2025
  
  41e6d686
21 Jul, 2025 1 commit
- update List · 267cc5ff
  zhuwenwen authored Jul 21, 2025
  
  267cc5ff
18 Jul, 2025 2 commits
- update fused_moe.py · b1babea8
  zhuwenwen authored Jul 18, 2025
  
  b1babea8
- fix run error · 5c004388
  zhuwenwen authored Jul 18, 2025
  
  5c004388
15 Jul, 2025 1 commit
- 修复在fp16下的数值越界导致的精度问题 · 18f030d9
  zhuwenwen authored Jul 15, 2025
  
  18f030d9
14 Jul, 2025 1 commit
- update blockwise_int8.py · 5d35160b
  zhuwenwen authored Jul 14, 2025
  
  5d35160b
12 Jul, 2025 1 commit
- remove qk contiguous · e34d3444
  zhuwenwen authored Jul 12, 2025
  
  e34d3444
11 Jul, 2025 1 commit
- add qk contiguous · bcf6be4c
  zhuwenwen authored Jul 11, 2025
  
  bcf6be4c
10 Jul, 2025 1 commit
- add apex rmsnorm · 3e0a595d
  zhuwenwen authored Jul 10, 2025
  
  3e0a595d
07 Jul, 2025 1 commit
- 修改激活量化算子实现方式 · b2fa85ce
  zhuwenwen authored Jul 07, 2025
  
  b2fa85ce
06 Jul, 2025 4 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [TPU][Bugfix] fix the MoE OOM issue (#20339) · 4548c03c
  Chengji Yao authored Jul 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  4548c03c
- [Bugfix] Fix missing per_act_token parameter in compressed_tensors_moe (#20509) · 43287082
  Lucia Fang authored Jul 06, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  43287082
05 Jul, 2025 2 commits
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
04 Jul, 2025 7 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
- 增加稠密模型channelwise autotuning 接口 · 3e485650
  zhuwenwen authored Jul 04, 2025
  
  3e485650
- Support Llama 4 for fused_marlin_moe (#20457) · 0e3fe896
  Michael Goin authored Jul 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0e3fe896
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 4 commits
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
- [Misc] Remove _maybe_ignore_quant_config from GLM4.1v (#20432) · 2f2fcb31
  Yuxuan Zhang authored Jul 04, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2f2fcb31
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda