Commits · 4b4eeb26d5e8f1000787973818b08e896dc27834 · OpenDAS / vllm_cscc

10 Oct, 2024 1 commit
- update benchmarks · 00d3d196
  zhuwenwen authored Oct 10, 2024
  
  00d3d196
26 Sep, 2024 1 commit
- support head_dim 160 and update benchmark_throughput.py · 93872128
  zhuwenwen authored Sep 26, 2024
  
  93872128
20 Sep, 2024 1 commit
- add benchmarks to vllm whl · 5b62725e
  zhuwenwen authored Sep 20, 2024
  
  5b62725e
10 Aug, 2024 2 commits
- Revert feat:optimize act_and_mul_kernel · 880b2e41
  zhuwenwen authored Aug 10, 2024
  
  880b2e41
- add benchmarks to vllm and add env of VLLM_USE_FLASH_ATTN_AUTO · efb2f75f
  zhuwenwen authored Aug 10, 2024
  
  efb2f75f