Create a small tutorial on how to accelerate HF Llama models with Transformer-Engine (#615)

0bd84ed9 · Sudhakar Singh · GitHub · df4bf796 · 0bd84ed9 · 0bd84ed9
Unverified Commit 0bd84ed9 authored Feb 29, 2024 by Sudhakar Singh Committed by GitHub Feb 29, 2024
14 changed files
--- a/docs/examples/te_llama/media/llama_for_causal_lm.svg
+++ b/docs/examples/te_llama/media/llama_for_causal_lm.svg
--- a/docs/examples/te_llama/media/llama_zoom.svg
+++ b/docs/examples/te_llama/media/llama_zoom.svg
--- a/docs/examples/te_llama/media/llamadecoderlayer.svg
+++ b/docs/examples/te_llama/media/llamadecoderlayer.svg
--- a/docs/examples/te_llama/media/model_change.svg
+++ b/docs/examples/te_llama/media/model_change.svg
--- a/docs/examples/te_llama/media/swiglu.svg
+++ b/docs/examples/te_llama/media/swiglu.svg
--- a/docs/examples/te_llama/media/swiglu_te.svg
+++ b/docs/examples/te_llama/media/swiglu_te.svg
--- a/docs/examples/te_llama/media/tellamadecoderlayer.svg
+++ b/docs/examples/te_llama/media/tellamadecoderlayer.svg
--- a/docs/examples/te_llama/media/transformer_llama.png
+++ b/docs/examples/te_llama/media/transformer_llama.png
--- a/docs/examples/te_llama/media/transformer_vs_llama.svg
+++ b/docs/examples/te_llama/media/transformer_vs_llama.svg
--- a/docs/examples/te_llama/media/weight_swap.svg
+++ b/docs/examples/te_llama/media/weight_swap.svg
--- a/docs/examples/te_llama/te_llama.py
+++ b/docs/examples/te_llama/te_llama.py
--- a/docs/examples/te_llama/tutorial_accelerate_hf_llama_with_te.ipynb
+++ b/docs/examples/te_llama/tutorial_accelerate_hf_llama_with_te.ipynb
--- a/docs/examples/te_llama/utils.py
+++ b/docs/examples/te_llama/utils.py
--- a/docs/index.rst
+++ b/docs/index.rst
@@ -44,6 +44,7 @@ Transformer Engine documentation

   examples/fp8_primer.ipynb
   examples/advanced_optimizations.ipynb
+   examples/te_llama/tutorial_accelerate_hf_llama_with_te.ipynb

 .. toctree::
   :hidden: