Skip to content

GitLab

Unverified Commit b45f6234 authored by Gustaf Ahdritz's avatar Gustaf Ahdritz Committed by GitHub
Browse files

(Temporarily) remove note about bfloat16 support

parent cf177c0c
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 4 deletions
README.md
View file @ b45f6234
...@@ -211,10 +211,6 @@ and supports the full range of training options that entails, including ...@@ -211,10 +211,6 @@ and supports the full range of training options that entails, including
multi-node distributed training. For more information, consult PyTorch multi-node distributed training. For more information, consult PyTorch
Lightning documentation and the `--help` flag of the training script. Lightning documentation and the `--help` flag of the training script.
Hardware permitting, you can train with `bfloat16` half-precision by passing
`bf16` as the `--precision` option. If you're using DeepSpeed, make sure to
enable `bfloat16` in the DeepSpeed config as well.
Note that the data directory can also contain PDB files previously output by Note that the data directory can also contain PDB files previously output by
the model. These are treated as members of the self-distillation set and are the model. These are treated as members of the self-distillation set and are
subjected to distillation-set-only preprocessing steps. subjected to distillation-set-only preprocessing steps.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment