Commit 57e017ff authored by lintangsutawika's avatar lintangsutawika
Browse files

formatting

parent c30b71c3
...@@ -150,7 +150,7 @@ It is on our roadmap to create task variants designed to enable models which do ...@@ -150,7 +150,7 @@ It is on our roadmap to create task variants designed to enable models which do
### Other Frameworks ### Other Frameworks
A number of other libraries contain scripts for calling the eval harness through their library. These include [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/blob/main/eval_tasks/eval_adapter.py), [Megatron-DeepSpeed](https://github.com/microsoft/Megatron-DeepSpeed/blob/main/examples/MoE/readme_evalharness.md), and [mesh-transformer-jax](https://github.com/kingoflolz/mesh-transformer-jax/blob/master/eval_harness.py). A number of other libraries contain scripts for calling the eval harness through their library. These include [GPT-NeoX](https://github.com/EleutherAI/gpt-neox/blob/main/eval_tasks/eval_adapter.py), [Megatron-DeepSpeed](https://github.com/microsoft/Megatron-DeepSpeed/blob/main/examples/MoE/readme_evalharness.md), and [mesh-transformer-jax](https://github.com/kingoflolz/mesh-transformer-jax/blob/master/eval_harness.py).
### Additional Features ### Additional Features
...@@ -158,7 +158,7 @@ If you have a Metal compatible Mac, you can run the eval harness using the MPS b ...@@ -158,7 +158,7 @@ If you have a Metal compatible Mac, you can run the eval harness using the MPS b
> [!Note] > [!Note]
> You can inspect what the LM inputs look like by running the following command: > You can inspect what the LM inputs look like by running the following command:
> >
> ```bash > ```bash
> python write_out.py \ > python write_out.py \
> --tasks all_tasks \ > --tasks all_tasks \
...@@ -166,7 +166,7 @@ If you have a Metal compatible Mac, you can run the eval harness using the MPS b ...@@ -166,7 +166,7 @@ If you have a Metal compatible Mac, you can run the eval harness using the MPS b
> --num_examples 10 \ > --num_examples 10 \
> --output_base_path /path/to/output/folder > --output_base_path /path/to/output/folder
> ``` > ```
> >
> This will write out one text file for each task. > This will write out one text file for each task.
To verify the data integrity of the tasks you're performing in addition to running the tasks themselves, you can use the `--check_integrity` flag: To verify the data integrity of the tasks you're performing in addition to running the tasks themselves, you can use the `--check_integrity` flag:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment