FA3 speed up: skip len operation and get batch size directly from forward batch (#5969)
Signed-off-by:
Lifu Huang <lifu.hlf@gmail.com>
Showing
Please register or sign in to comment
Signed-off-by:
Lifu Huang <lifu.hlf@gmail.com>