Unverified Commit 018936a3 authored by binmakeswell's avatar binmakeswell Committed by GitHub
Browse files

[tutorial] update notes for TransformerEngine (#3098)

parent 65a4dbda
# Basic MNIST Example with optional FP8 # Basic MNIST Example with optional FP8 of TransformerEngine
[TransformerEngine](https://github.com/NVIDIA/TransformerEngine) is a library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper GPUs, to provide better performance with lower memory utilization in both training and inference.
Thanks for the contribution to this tutorial from NVIDIA.
```bash ```bash
python main.py python main.py
python main.py --use-te # Linear layers from TransformerEngine python main.py --use-te # Linear layers from TransformerEngine
python main.py --use-fp8 # FP8 + TransformerEngine for Linear layers python main.py --use-fp8 # FP8 + TransformerEngine for Linear layers
``` ```
> We are working to integrate it with Colossal-AI and will finish it soon.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment