Commit 2a3c88a6 authored by Victor SANH's avatar Victor SANH
Browse files

Update examples/movement-pruning/README.md


Co-authored-by: default avatarJulien Chaumond <chaumond@gmail.com>
parent 4ac462bf
...@@ -159,7 +159,7 @@ python examples/movement-pruning/bertarize.py \ ...@@ -159,7 +159,7 @@ python examples/movement-pruning/bertarize.py \
For reproducibility purposes, we share the detailed results presented in the paper. This [spreadsheet](TODO) exhaustively describes the individual hyper-parameters used for each data point. For reproducibility purposes, we share the detailed results presented in the paper. This [spreadsheet](TODO) exhaustively describes the individual hyper-parameters used for each data point.
## Remarks ## Inference speed
Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference. Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference.
We are currently benchmarking and exploring inference setups specifically for sparse architectures. We are currently benchmarking and exploring inference setups specifically for sparse architectures.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment