Commit a51f5fb5 authored by Sachin Kadyan's avatar Sachin Kadyan
Browse files

Added training preset for sequence embedding finetuning training.

- Turn on `seqemb` mode in `data`, `model`, and `globals` config when using `seqemb` training preset.
- Set configuration options specific for finetuning in general.
parent bbdaacfd
...@@ -158,6 +158,14 @@ def model_config( ...@@ -158,6 +158,14 @@ def model_config(
c.globals.seqemb_mode_enabled = True c.globals.seqemb_mode_enabled = True
c.model.extra_msa.enabled = False c.model.extra_msa.enabled = False
c.model.evoformer_stack.no_column_attention = True c.model.evoformer_stack.no_column_attention = True
elif name == "seqemb_finetuning":
c.data.seqemb_mode.enabled = True
c.globals.seqemb_mode_enabled = True
c.model.extra_msa.enabled = False
c.model.evoformer_stack.no_column_attention = True
c.data.train.crop_size = 384
c.loss.violation.weight = 1.
c.loss.experimentally_resolved.weight = 0.01
else: else:
raise ValueError("Invalid model name") raise ValueError("Invalid model name")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment