Skip to content

GitLab

"git@developer.sourcefind.cn:xdb4_94051/vllm.git" did not exist on "0961f5a49a7f826a8b8be08451b308b374868c51"
Switch branch/tag
Find file BlameHistoryPermalink
  • Jianfeng Yan's avatar
    Batched gemm and reduction (#156) · 34c661e7
    Jianfeng Yan authored 
    * adding batched_gemm_and_reduction

* batched_gemm_reduce works with bactch_count=1

* fix a bug in grid_size; batched_gemm_reduce works for batch_count > 1

* adding profiler for batched_gemm_fp16

* fixed a bug in declaration of d1 and d0; both example and profiler work

* clang-format

* cleanup

* batched_gemm_reduce: add test

* minor change

* fixed some typo in function names
    34c661e7
profile_batched_gemm_impl.hpp 19.8 KB