• Shaden Smith's avatar
    Ported Megatron tutorial. (#30) · 073da729
    Shaden Smith authored
    
    
    * Ported DeepSpeed overview.
    
    * Renamed subsection
    
    * Formatting table of contents
    
    * initial import of Megatron tutorial
    
    * Grammatical edits, formatting, and paths.
    
    * formatting and data download instructions
    
    * formatting tutorial
    
    * formatting tutorial
    
    * formatting tutorial
    
    * formatting tutorial
    
    * formatting tutorial
    
    * formatting tutorial
    
    * new perf chart
    
    * removing TODO
    
    * adding pointer to tutorial
    
    * edits
    
    * azure to low bandwidth
    Co-authored-by: default avatarSamyam Rajbhandari <samyamr@microsoft.com>
    073da729
MegatronGPT2Tutorial.md 15.9 KB