Unverified Commit 73ff00ea authored by Asit's avatar Asit Committed by GitHub
Browse files

Updating comment

Minor edit
parent 8923046f
...@@ -53,8 +53,8 @@ def m4n2_1d(mat, density): ...@@ -53,8 +53,8 @@ def m4n2_1d(mat, density):
Below 2d-masking related code is targeted more for training (from scratch). Below 2d-masking related code is targeted more for training (from scratch).
2d-pruning of a weight tensor is done to accelerate DGRAD step during backprop 2d-pruning of a weight tensor is done to accelerate DGRAD step during backprop
phase of training algorithm. Acceleration comes from using SpMMA instructions in phase of training algorithm. Acceleration comes from using SpMMA instructions in
Tensor Cores of NVIDIA Ampere GPU (note: this code does not do the acceleration, Tensor Cores of NVIDIA Ampere GPU Architecture
GPU kernels are required for this). (note: this code does not do the acceleration, GPU kernels are required for this).
1d pruning of weight tensor helps speed up FPROP step by pruning in 2:4 pattern 1d pruning of weight tensor helps speed up FPROP step by pruning in 2:4 pattern
along the horizontal (logical) direction. along the horizontal (logical) direction.
During DGRAD step, weight tensor is transposed. 2d pruning functions below, mask During DGRAD step, weight tensor is transposed. 2d pruning functions below, mask
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment