Unverified Commit 84790e99 authored by Alex Bäuerle's avatar Alex Bäuerle Committed by GitHub
Browse files

update Zeno example and reference in README (#1190)

parent 9cd79897
...@@ -269,6 +269,8 @@ python scripts/zeno_visualize.py \ ...@@ -269,6 +269,8 @@ python scripts/zeno_visualize.py \
This will use all subfolders in `data_path` as different models and upload all tasks within these model folders to Zeno. This will use all subfolders in `data_path` as different models and upload all tasks within these model folders to Zeno.
If you run the eval harness on multiple tasks, the `project_name` will be used as a prefix and one project will be created per task. If you run the eval harness on multiple tasks, the `project_name` will be used as a prefix and one project will be created per task.
You can find an example of this workflow in [examples/visualize-zeno.ipynb](examples/visualize-zeno.ipynb).
## How to Contribute or Learn More? ## How to Contribute or Learn More?
For more information on the library and how everything fits together, check out all of our [documentation pages](https://github.com/EleutherAI/lm-evaluation-harness/tree/big-refactor/docs)! We plan to post a larger roadmap of desired + planned library improvements soon, with more information on how contributors can help. For more information on the library and how everything fits together, check out all of our [documentation pages](https://github.com/EleutherAI/lm-evaluation-harness/tree/big-refactor/docs)! We plan to post a larger roadmap of desired + planned library improvements soon, with more information on how contributors can help.
......
...@@ -20,7 +20,8 @@ ...@@ -20,7 +20,8 @@
"outputs": [], "outputs": [],
"source": [ "source": [
"# Install this project if you did not already do that. This is all that needs to be installed for you to be able to visualize your data in Zeno!\n", "# Install this project if you did not already do that. This is all that needs to be installed for you to be able to visualize your data in Zeno!\n",
"!pip install .." "!pip install -e ..\n",
"!pip install -e ..[zeno]"
] ]
}, },
{ {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment