Commits · ffaad3df02360b7a7b5ace95eeb13476241efbe2 · OpenDAS / vllm_cscc

31 Jul, 2025 1 commit
- update arg_utils.py · ffaad3df
  zhuwenwen authored Jul 31, 2025
  
  ffaad3df
30 Jul, 2025 2 commits
- Merge v0.9.2-dev-disagg into v0.9.2-dev · af27c177
  xuxz authored Jul 30, 2025
  
  af27c177
- 解决v1cudagraph的问题以及接入fuse moe marlin_V3版本 · 9820d063
  yangql authored Jul 30, 2025
  
  9820d063
29 Jul, 2025 2 commits
- [Misc] Clean up Aimv2 config registration in Ovis config · be0549c4
  zhuwenwen authored Jul 29, 2025
  
  be0549c4
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
28 Jul, 2025 1 commit
- add v1 cpm support · 98958aed
  zhuwenwen authored Jul 28, 2025
  
  98958aed
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
25 Jul, 2025 5 commits
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
- [fix]解决deepseek报错 · cf4c84b5
  王敏 authored Jul 25, 2025
  
  cf4c84b5
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
- set VLLM_USE_V1=1 · e4a84fdc
  zhuwenwen authored Jul 25, 2025
  
  e4a84fdc
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54
24 Jul, 2025 4 commits
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576
- update fa v1 interface · f9408aff
  zhuwenwen authored Jul 24, 2025
  
  f9408aff
- add fused_experts_impl of int8 · 41e6d686
  zhuwenwen authored Jul 24, 2025
  
  41e6d686
- skip fp8 and ActivationQuantFusionPass · a246d08c
  zhuwenwen authored Jul 24, 2025
  
  a246d08c
22 Jul, 2025 2 commits
- update max_seq_len_to_capture to option int · d560429c
  zhuwenwen authored Jul 22, 2025
  
  d560429c
- update max_seq_len_to_capture to int · 988fc31c
  zhuwenwen authored Jul 22, 2025
  
  988fc31c
21 Jul, 2025 2 commits
- update max_seq_len_to_capture · 72273242
  zhuwenwen authored Jul 21, 2025
  
  72273242
- update List · 267cc5ff
  zhuwenwen authored Jul 21, 2025
  
  267cc5ff
18 Jul, 2025 2 commits
- update fused_moe.py · b1babea8
  zhuwenwen authored Jul 18, 2025
  
  b1babea8
- fix run error · 5c004388
  zhuwenwen authored Jul 18, 2025
  
  5c004388
17 Jul, 2025 4 commits
- update adpaptive block_size · 937a3ec1
  zhuwenwen authored Jul 17, 2025
  
  937a3ec1
- update default block_size · 4a84480f
  zhuwenwen authored Jul 17, 2025
  
  4a84480f
- set default block_size and pa · b61f7a69
  zhuwenwen authored Jul 17, 2025
  
  b61f7a69
- add VLLM_USE_PA_PRINT_PARAM to print fa-pa size · 1092a467
  zhuwenwen authored Jul 17, 2025
  
  1092a467
15 Jul, 2025 1 commit
- 修复在fp16下的数值越界导致的精度问题 · 18f030d9
  zhuwenwen authored Jul 15, 2025
  
  18f030d9
14 Jul, 2025 1 commit
- update blockwise_int8.py · 5d35160b
  zhuwenwen authored Jul 14, 2025
  
  5d35160b
12 Jul, 2025 2 commits
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
- remove qk contiguous · e34d3444
  zhuwenwen authored Jul 12, 2025
  
  e34d3444
11 Jul, 2025 2 commits
- tbo debug fix error · 957096ce
  lizhigong authored Jul 11, 2025
  
  957096ce
- add qk contiguous · bcf6be4c
  zhuwenwen authored Jul 11, 2025
  
  bcf6be4c
10 Jul, 2025 5 commits
- add apex rmsnorm · 3e0a595d
  zhuwenwen authored Jul 10, 2025
  
  3e0a595d
- fix zero overhead to support chunk prefill · a495fc3b
  zhuwenwen authored Jul 10, 2025
  
  a495fc3b
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
- update bw vdim128 · d805c59c
  zhuwenwen authored Jul 10, 2025
  
  d805c59c
- [fix]修复091 v0 engine mtp报错问题 · ac182341
  王敏 authored Jul 10, 2025
  
  ac182341
09 Jul, 2025 1 commit
- [fix]修复零消耗引入的cudagraph模式数据准备cpu耗时问题 · cd6239dc
  zhuwenwen authored Jul 09, 2025
  
  cd6239dc
07 Jul, 2025 2 commits
- 还原误删代码 · f0acced0
  王敏 authored Jul 07, 2025
  
  f0acced0
- 删掉无效代码 · ee9ee960
  王敏 authored Jul 07, 2025
  
  ee9ee960