Unverified Commit 663b781b authored by Leo Gao's avatar Leo Gao Committed by GitHub
Browse files

Merge pull request #291 from StephenHogg/check_integrity_docs

Add comment to README explaining check integrity flag
parents 93cf95d0 fff69d42
......@@ -51,6 +51,15 @@ python main.py \
--tasks lambada,hellaswag
```
And if you want to verify the data integrity of the tasks you're performing in addition to running the tasks themselves, you can use the `--check_integrity` flag:
```bash
python main.py \
--model gpt3 \
--model_args engine=davinci \
--tasks lambada,hellaswag \
--check_integrity
```
To evaluate mesh-transformer-jax models that are not available on HF, please invoke eval harness through [this script](https://github.com/kingoflolz/mesh-transformer-jax/blob/master/eval_harness.py).
## Implementing new tasks
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment