"...git@developer.sourcefind.cn:kecinstone/2024-pra-vllm.git" did not exist on "03ffd0a02251e10c1aa14fca8cb0ab1e4e40b886"
-
Phuong Nguyen authored
* refactor + mxfp8 * added grouped gemm * rename linear to dense * added cublas init phase for groupedGemm * relax the tol of test encoder multiprocessing mxfp8 by 0.001 Signed-off-by:
Phuong Nguyen <phuonguyen@nvidia.com> --------- Signed-off-by:
Hua Huang <huah@nvidia.com> Co-authored-by:
Jeremy Berchtold <jberchtold@nvidia.com>
cf9a7c2f
