Skip to content

GitLab

Commit c80b4230 authored by Lawrence McAfee's avatar Lawrence McAfee
Browse files

added activation checkpointing link.

parent 5f694372
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
README.md
View file @ c80b4230
...@@ -40,6 +40,7 @@ The following table shows both model (MFU) and hardware (HFU) FLOPs utilization ...@@ -40,6 +40,7 @@ The following table shows both model (MFU) and hardware (HFU) FLOPs utilization
* [GPT Pretraining](#gpt-pretraining) * [GPT Pretraining](#gpt-pretraining)
* [T5 Pretraining](#t5-pretraining) * [T5 Pretraining](#t5-pretraining)
* [Distributed Pretraining](#distributed-pretraining) * [Distributed Pretraining](#distributed-pretraining)
* [Activation Checkpointing and Recomputation](#activation-checkpointing-and-recomputation)
* [GPT-3 Example](#gpt-3-example) * [GPT-3 Example](#gpt-3-example)
* [Evaluation and Tasks](#evaluation-and-tasks) * [Evaluation and Tasks](#evaluation-and-tasks)
* [GPT Text Generation](#gpt-text-generation) * [GPT Text Generation](#gpt-text-generation)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment