Skip to content

GitLab

"git@developer.sourcefind.cn:norm/vllm.git" did not exist on "054072bee534faa9fae53dd9c14e91873d76204a"
Unverified Commit 57b1afab authored by Ningxin Zheng's avatar Ningxin Zheng Committed by GitHub
Browse files

update the compression doc (#3293)

parent b9c65391
Hide whitespace changes
Inline Side-by-side
Showing with 10 additions and 0 deletions
docs/en_US/Compression/ModelSpeedup.rst
View file @ 57b1afab
...@@ -188,3 +188,13 @@ input tensor: ``torch.randn(64, 3, 32, 32)`` ...@@ -188,3 +188,13 @@ input tensor: ``torch.randn(64, 3, 32, 32)``
- 0.12421 - 0.12421
- 0.087113 - 0.087113
SimulatedAnnealing pruner example
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
In this experiment, we use SimulatedAnnealing pruner to prune the resnet18 on the cifar10 dataset.
We measure the latencies and accuracies of the pruned model under different sparsity ratios, as shown in the following figure.
The latency is measured on one V100 GPU and the input tensor is ``torch.randn(128, 3, 32, 32)``.
.. image:: ../../img/SA_latency_accuracy.png
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment