Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
OpenFold
Commits
90ce2be9
Commit
90ce2be9
authored
Nov 29, 2021
by
Gustaf Ahdritz
Browse files
Describe bfloat16 support in README
parent
29be56e5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
3 deletions
+6
-3
README.md
README.md
+6
-3
No files found.
README.md
View file @
90ce2be9
...
...
@@ -18,9 +18,8 @@ OpenFold is built to support inference with AlphaFold's original JAX weights.
Try it out with our
[
Colab notebook
](
https://colab.research.google.com/github/aqlaboratory/openfold/blob/main/notebooks/OpenFold.ipynb
)
.
Unlike DeepMind's public code, OpenFold is also trainable. It can be trained
with
[
DeepSpeed
](
https://github.com/microsoft/deepspeed
)
and with mixed
precision.
`bfloat16`
training is not currently supported, but will be in the
future.
with
[
DeepSpeed
](
https://github.com/microsoft/deepspeed
)
and with both
`fp16`
and
`bfloat16`
half-precision.
## Installation (Linux)
...
...
@@ -208,6 +207,10 @@ and supports the full range of training options that entails, including
multi-node distributed training. For more information, consult PyTorch
Lightning documentation and the
`--help`
flag of the training script.
Hardware permitting, you can train with
`bfloat16`
half-precision by passing
`bf16`
as the
`--precision`
option. If you're using DeepSpeed, make sure to
enable
`bfloat16`
in the DeepSpeed config as well.
Note that the data directory can also contain PDB files previously output by
the model. These are treated as members of the self-distillation set and are
subjected to distillation-set-only preprocessing steps.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment