Commits · fa5b0b39ff8ad2a3e712a20ff21092cfc5d259f4 · OpenDAS / vllm_cscc

25 Oct, 2024 1 commit
- support telechat-12b · fa5b0b39
  zhuwenwen authored Oct 25, 2024
  
  fa5b0b39
17 Oct, 2024 1 commit
- add VLLM_USE_TC_PAGED_ATTN to convert tc pa · f164171b
  zhuwenwen authored Oct 17, 2024
  
  f164171b
26 Sep, 2024 1 commit
- support head_dim 160 and update benchmark_throughput.py · 93872128
  zhuwenwen authored Sep 26, 2024
  
  93872128
24 Sep, 2024 1 commit
- 优化pa小batch性能（pa_v2），优化pa小seq性能(pa_v1)，reusekv=16优化 · 2b91ac93
  zhuwenwen authored Sep 24, 2024
  
  2b91ac93
20 Sep, 2024 1 commit
- add pa tc · 0c70376b
  zhuwenwen authored Sep 20, 2024
  
  0c70376b
29 Jul, 2024 1 commit
- 增加head size 64-256支持 · 69185c0b
  zhangshao authored Jul 29, 2024
  
  69185c0b
22 Jul, 2024 1 commit
- pa优化，编译选项优化 · 1be9a629
  zhangshao authored Jul 22, 2024
  
  1be9a629