Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "1b151ed181f5ef0d267c1cf6d15d6f6f43e302ed"
Commit 98a64039 authored by lcskrishna's avatar lcskrishna
Browse files

bug fixes in sgd kernel in bfp16 bringup

parent b2da92fc
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
csrc/multi_tensor_sgd_kernel.cu
View file @ 98a64039
...@@ -271,7 +271,7 @@ void multi_tensor_sgd_cuda( ...@@ -271,7 +271,7 @@ void multi_tensor_sgd_cuda(
scale); scale);
} }
// Case 5. bfp16, bfp16, bfp16, No // Case 5. bfp16, bfp16, bfp16, No
if(grad_type == at::ScalarType::BFloat16 && else if(grad_type == at::ScalarType::BFloat16 &&
weight_type == at::ScalarType::BFloat16 && weight_type == at::ScalarType::BFloat16 &&
num_tensors == 3) num_tensors == 3)
{ {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment