Unverified Commit d83fc511 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Update model_guide.md

parent f73c2bc8
...@@ -12,7 +12,6 @@ To get started contributing, go ahead and fork the main repo, clone it, create a ...@@ -12,7 +12,6 @@ To get started contributing, go ahead and fork the main repo, clone it, create a
# After forking... # After forking...
git clone https://github.com/<YOUR-USERNAME>/lm-evaluation-harness.git git clone https://github.com/<YOUR-USERNAME>/lm-evaluation-harness.git
cd lm-evaluation-harness cd lm-evaluation-harness
git checkout big-refactor
git checkout -b <model-type> git checkout -b <model-type>
pip install -e ".[dev]" pip install -e ".[dev]"
``` ```
...@@ -46,7 +45,7 @@ class MyCustomLM(LM): ...@@ -46,7 +45,7 @@ class MyCustomLM(LM):
#... #...
#... #...
``` ```
Where `Instance` is a dataclass defined in [`lm_eval.api.instance`](https://github.com/EleutherAI/lm-evaluation-harness/blob/big-refactor/lm_eval/api/instance.py) with property `args` of request-dependent type signature described below. Where `Instance` is a dataclass defined in [`lm_eval.api.instance`](https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/api/instance.py) with property `args` of request-dependent type signature described below.
We support three types of requests, consisting of different interactions / measurements with an autoregressive LM. We support three types of requests, consisting of different interactions / measurements with an autoregressive LM.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment