Unverified Commit c10d6854 authored by regisss's avatar regisss Committed by GitHub
Browse files

Update numbers for Habana Gaudi in documentation (#2734)

Update numbers for Habana Gaudi in doc
parent 73bdad08
...@@ -16,8 +16,8 @@ specific language governing permissions and limitations under the License. ...@@ -16,8 +16,8 @@ specific language governing permissions and limitations under the License.
## Requirements ## Requirements
- Optimum Habana 1.3 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it. - Optimum Habana 1.4 or later, [here](https://huggingface.co/docs/optimum/habana/installation) is how to install it.
- SynapseAI 1.7. - SynapseAI 1.8.
## Inference Pipeline ## Inference Pipeline
...@@ -62,9 +62,9 @@ For more information, check out Optimum Habana's [documentation](https://hugging ...@@ -62,9 +62,9 @@ For more information, check out Optimum Habana's [documentation](https://hugging
## Benchmark ## Benchmark
Here are the latencies for Habana Gaudi 1 and Gaudi 2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32): Here are the latencies for Habana first-generation Gaudi and Gaudi2 with the [Habana/stable-diffusion](https://huggingface.co/Habana/stable-diffusion) Gaudi configuration (mixed precision bf16/fp32):
| | Latency | Batch size | | | Latency (batch size = 1) | Throughput (batch size = 8) |
| ------- |:-------:|:----------:| | ---------------------- |:------------------------:|:---------------------------:|
| Gaudi 1 | 4.37s | 4/8 | | first-generation Gaudi | 4.29s | 0.283 images/s |
| Gaudi 2 | 1.19s | 4/8 | | Gaudi2 | 1.54s | 0.904 images/s |
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment