"scripts/llama2_7b.sh" did not exist on "64c0033eba5c2d71b3acac46172baadcd2cfe2cf"
index.rst 1.31 KB
Newer Older
Christian Sarofeen's avatar
Christian Sarofeen committed
1
2
3
4
5
.. PyTorch documentation master file, created by
   sphinx-quickstart on Fri Dec 23 13:31:47 2016.
   You can adapt this file completely to your liking, but it should at least
   contain the root `toctree` directive.

6
:github_url: https://github.com/nvidia/apex
Christian Sarofeen's avatar
Christian Sarofeen committed
7

8
Apex (A PyTorch Extension)
Christian Sarofeen's avatar
Christian Sarofeen committed
9
10
===================================

11
12
This site contains the API documentation for Apex (https://github.com/nvidia/apex),
a Pytorch extension with NVIDIA-maintained utilities to streamline mixed precision and distributed training.  Some of the code here will be included in upstream Pytorch eventually. The intention of Apex is to make up-to-date utilities available to users as quickly as possible.
Christian Sarofeen's avatar
Christian Sarofeen committed
13

14
15
Installation requires CUDA 9 or later, PyTorch 0.4 or later, and Python 3. Install by running

Christian Sarofeen's avatar
Christian Sarofeen committed
16
::
17
18
19

   git clone https://www.github.com/nvidia/apex
   cd apex
20
   python setup.py install [--cuda_ext] [--cpp_ext]
Christian Sarofeen's avatar
Christian Sarofeen committed
21
22

	       
23
24
25
26
27
.. toctree::
   :maxdepth: 1
   :caption: AMP:  Automatic Mixed Precision

   amp
Christian Sarofeen's avatar
Christian Sarofeen committed
28
29
30

.. toctree::
   :maxdepth: 1
31
   :caption: FP16/Mixed Precision Utilities
Christian Sarofeen's avatar
Christian Sarofeen committed
32
33

   fp16_utils
34
35
36
37
38
39
40

.. toctree::
   :maxdepth: 1
   :caption: Distributed Training

   parallel

41
42
43
44
45
46
.. toctree::
   :maxdepth: 1
   :caption: Fused Optimizers

   optimizers

47
48
..   reparameterization
..   RNN
Christian Sarofeen's avatar
Christian Sarofeen committed
49
50
51
52
53
54
   
Indices and tables
==================

* :ref:`genindex`
* :ref:`modindex`