Commits · 539aa9926007d4896397ca3fa83d48da492b4831 · OpenDAS / vllm_cscc

26 Sep, 2024 1 commit
- support head_dim 160 and update benchmark_throughput.py · 93872128
  zhuwenwen authored Sep 26, 2024
  
  93872128
20 Sep, 2024 1 commit
- add benchmarks to vllm whl · 5b62725e
  zhuwenwen authored Sep 20, 2024
  
  5b62725e
10 Aug, 2024 2 commits
- Revert feat:optimize act_and_mul_kernel · 880b2e41
  zhuwenwen authored Aug 10, 2024
  
  880b2e41
- add benchmarks to vllm and add env of VLLM_USE_FLASH_ATTN_AUTO · efb2f75f
  zhuwenwen authored Aug 10, 2024
  
  efb2f75f