GitLab

- much faster due to the use of threading and mp
- also supports sharding

Bugfix: Corrected paths for just-in-time embedding generation

  instead of pip
- Adds helper line to automatically prepend conda library to
  $LD_LIBRARY_PATH

- much faster due to the use of threading and mp
- also supports sharding

tests in test_data_transforms.py

Previously, long sequences were not excluded from the script.
This commit changes the comparison to exclude sequences with length
greater than args.max_seqlen.

warmup_decay_num_steps is a valid user argument but is not added to the config.
This commit adds this argument to the configuration output.

Because download_mm_seqs_dbs.sh downloads and gunzips its target file (uniref30_2103.tar.gz), this script mistakenly does not process the .tar file. This fix expands the glob to match *.tar*.

Also fix a typo in the README

Also drop the wget -q flag so errors are apparent