Skip to content

GitLab

"lib/bindings/python/Cargo.lock" did not exist on "f38aa46949d8b016b5c4ae559daeb694152d0e40"
Commit 90ce2be9 authored by Gustaf Ahdritz's avatar Gustaf Ahdritz
Browse files

Describe bfloat16 support in README

parent 29be56e5
Show whitespace changes
Inline Side-by-side
Showing with 6 additions and 3 deletions
README.md
View file @ 90ce2be9
...@@ -18,9 +18,8 @@ OpenFold is built to support inference with AlphaFold's original JAX weights. ...@@ -18,9 +18,8 @@ OpenFold is built to support inference with AlphaFold's original JAX weights.
Try it out with our [Colab notebook](https://colab.research.google.com/github/aqlaboratory/openfold/blob/main/notebooks/OpenFold.ipynb). Try it out with our [Colab notebook](https://colab.research.google.com/github/aqlaboratory/openfold/blob/main/notebooks/OpenFold.ipynb).
Unlike DeepMind's public code, OpenFold is also trainable. It can be trained Unlike DeepMind's public code, OpenFold is also trainable. It can be trained
with [DeepSpeed](https://github.com/microsoft/deepspeed) and with mixed with [DeepSpeed](https://github.com/microsoft/deepspeed) and with both `fp16`
precision. `bfloat16` training is not currently supported, but will be in the and `bfloat16` half-precision.
future.
## Installation (Linux) ## Installation (Linux)
...@@ -208,6 +207,10 @@ and supports the full range of training options that entails, including ...@@ -208,6 +207,10 @@ and supports the full range of training options that entails, including
multi-node distributed training. For more information, consult PyTorch multi-node distributed training. For more information, consult PyTorch
Lightning documentation and the `--help` flag of the training script. Lightning documentation and the `--help` flag of the training script.
Hardware permitting, you can train with `bfloat16` half-precision by passing
`bf16` as the `--precision` option. If you're using DeepSpeed, make sure to
enable `bfloat16` in the DeepSpeed config as well.
Note that the data directory can also contain PDB files previously output by Note that the data directory can also contain PDB files previously output by
the model. These are treated as members of the self-distillation set and are the model. These are treated as members of the self-distillation set and are
subjected to distillation-set-only preprocessing steps. subjected to distillation-set-only preprocessing steps.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment