Unverified Commit b45f6234 authored by Gustaf Ahdritz's avatar Gustaf Ahdritz Committed by GitHub
Browse files

(Temporarily) remove note about bfloat16 support

parent cf177c0c
......@@ -211,10 +211,6 @@ and supports the full range of training options that entails, including
multi-node distributed training. For more information, consult PyTorch
Lightning documentation and the `--help` flag of the training script.
Hardware permitting, you can train with `bfloat16` half-precision by passing
`bf16` as the `--precision` option. If you're using DeepSpeed, make sure to
enable `bfloat16` in the DeepSpeed config as well.
Note that the data directory can also contain PDB files previously output by
the model. These are treated as members of the self-distillation set and are
subjected to distillation-set-only preprocessing steps.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment