- 13 Jun, 2023 1 commit
-
-
gk authored
-
- 11 Jun, 2023 1 commit
-
-
gk authored
-
- 08 Jun, 2023 4 commits
-
-
Stella Biderman authored
Revert "Add MultipleChoiceExactTask"
-
Stella Biderman authored
-
Stella Biderman authored
Add MultipleChoiceExactTask
-
Jason Phang authored
* add anthropic support * move requirement
-
- 07 Jun, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 06 Jun, 2023 4 commits
-
-
gk authored
-
gakada authored
-
Lintang Sutawika authored
-
Kacper Wikieł authored
-
- 05 Jun, 2023 3 commits
-
-
gakada authored
-
gakada authored
-
Stella Biderman authored
-
- 01 Jun, 2023 1 commit
-
-
gakada authored
* Fix tokenization issue in BaseLM.loglikelihood * Add a regression script * Use entire non-continuation length as context --------- Co-authored-by:Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
-
- 30 May, 2023 1 commit
-
-
Sam Passaglia authored
-
- 27 May, 2023 1 commit
-
-
Stella Biderman authored
Add support for loading GPTQ models via AutoGPTQ
-
- 26 May, 2023 1 commit
-
-
gk authored
-
- 25 May, 2023 2 commits
-
-
Hailey Schoelkopf authored
* allow for hf-causal to take dtype arg * document this change
-
gk authored
-
- 23 May, 2023 4 commits
-
-
Lintang Sutawika authored
-
lintangsutawika authored
-
lintangsutawika authored
-
gk authored
-
- 21 May, 2023 4 commits
-
-
Stella Biderman authored
Add perplexity task on arbitrary JSON data
-
Stella Biderman authored
-
Stella Biderman authored
Add option to dump prompts and completions to a JSON file
-
Stella Biderman authored
Evaluation Against Portion of Benchmark Data
-
- 19 May, 2023 2 commits
-
-
Stella Biderman authored
Add results of various models in json and md format
-
Stella Biderman authored
Create output path directory if necessary
-
- 18 May, 2023 1 commit
-
-
Stella Biderman authored
-
- 12 May, 2023 1 commit
-
-
Julen Etxaniz authored
-
- 11 May, 2023 3 commits
-
-
Julen Etxaniz authored
* add xcopa dataset * add xstory_cloze dataset and run pre-commit * fix xcopa validation and test sets * add xwinograd dataset * add pawsx task * add xnli task * update task table with recently added tasks * remove unused metrics from paws-x * add mgsm task and fix gsm8k * fix gsm8k until * update task table
-
Julen Etxaniz authored
-
Julen Etxaniz authored
-
- 10 May, 2023 4 commits
-
-
Stella Biderman authored
fix adaptive batch crash when there are no new requests
-
Stella Biderman authored
-
Julen Etxaniz authored
-
Jeffrey Quesnelle authored
-
- 09 May, 2023 1 commit
-
-
Stella Biderman authored
-
