README.md 718 Bytes
Newer Older
haileyschoelkopf's avatar
haileyschoelkopf committed
1
2
# Eval Harness Documentation

lintangsutawika's avatar
lintangsutawika committed
3
Welcome to the docs for the LM Evaluation Harness!
haileyschoelkopf's avatar
haileyschoelkopf committed
4
5
6

## Table of Contents

7
8
9
10
* To learn about the public interface of the library, as well as how to evaluate via the commandline or as integrated into an external library, see the [Interface](./interface.md)
* To learn how to add a new library, API, or model type to the library, as well as a quick explainer on the types of ways to evaluate an LM, see the [Model Guide](./model_guide.md).
* For a crash course on adding new tasks to the library, see our [New Task Guide](./new_task_guide.md).
* To learn more about pushing the limits of task configuration that the Eval Harness supports, see the [Task Configuration Guide](./task_guide.md).