GitLab

Merge branch 'Refactor]-fix-anthropic-import-bug' of https://github.com/EleutherAI/lm-evaluation-harness into Refactor]-fix-anthropic-import-bug

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into Refactor]-fix-anthropic-import-bug

[Refactor] Port over Autobatching

Update README.md

Update huggingface.py

`max_length` was misdefined as a tuple.

Add note about MPS

[Refactor] Fix Max Length arg

`anthropic` is an optional library to install but `anthropic_llms.py` is always imported.

Add a way to check if the module is imported or not.

[Refactor] Benchmark scripts

Update README.md

[Refactor] Cleanup for `big-refactor`

[Refactor] Updated anthropic to new API

[Refactor] Fixes for when using `num_fewshot`