"vscode:/vscode.git/clone" did not exist on "f0181436f41c730aad068029f54a3f86f354442d"
Commit db1d67f6 authored by Stephen Hogg's avatar Stephen Hogg
Browse files

Add comment to README explaining check integrity flag

parent 93cf95d0
...@@ -51,6 +51,16 @@ python main.py \ ...@@ -51,6 +51,16 @@ python main.py \
--tasks lambada,hellaswag --tasks lambada,hellaswag
``` ```
And if you want to verify the data integrity of the tasks you're performing in addition to running the tasks themselves:
```bash
export OPENAI_API_SECRET_KEY=YOUR_KEY_HERE
python main.py \
--model gpt3 \
--model_args engine=davinci \
--tasks lambada,hellaswag \
--check_integrity
```
To evaluate mesh-transformer-jax models that are not available on HF, please invoke eval harness through [this script](https://github.com/kingoflolz/mesh-transformer-jax/blob/master/eval_harness.py). To evaluate mesh-transformer-jax models that are not available on HF, please invoke eval harness through [this script](https://github.com/kingoflolz/mesh-transformer-jax/blob/master/eval_harness.py).
## Implementing new tasks ## Implementing new tasks
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment