Commits · b0cf01636b0652653fcacf347c648b2c999e2bb0 · gaoqiong / lm-evaluation-harness

05 May, 2021 1 commit
- Begin refactoring perplexity code · b0cf0163
  Leo Gao authored May 04, 2021
  
  b0cf0163
03 May, 2021 2 commits
- gpt3 compatibility · fa80f7bd
  Jason Phang authored May 02, 2021
  
  fa80f7bd
- gpt2 perplexity · 9454c839
  Jason Phang authored May 02, 2021
  
  9454c839
11 Apr, 2021 3 commits
- More refactoring of model code · a586a5c4
  Leo Gao authored Apr 11, 2021
  
  a586a5c4
- Refactor gpt3 loglikelihood · ab1fdc54
  Leo Gao authored Apr 11, 2021
  
  ab1fdc54
- Refactor gpt2 loglikelihood · 8352e671
  Leo Gao authored Apr 11, 2021
  
  8352e671
08 Apr, 2021 1 commit
- gpt2: Mask out all tokens above 50256 · 2b8956b8
  Leo Gao authored Apr 07, 2021
  
  2b8956b8
05 Apr, 2021 1 commit
- Implement partial caching · efbe6e7f
  Leo Gao authored Apr 04, 2021
```
Now, if a run gets interrupted halfway, you can easily resume
```
  efbe6e7f
02 Apr, 2021 1 commit
- Roll back last token optimization · f3fee648
  Leo Gao authored Apr 02, 2021
  
  f3fee648
31 Mar, 2021 1 commit
- Handle GPTNeoConfig not having n_ctx · 49ee4db2
  Leo Gao authored Mar 30, 2021
  
  49ee4db2
27 Mar, 2021 3 commits
- Patch gpt3lm · ca57061c
  Leo Gao authored Mar 26, 2021
  
  ca57061c
- Minor updates · bc5478a1
  Leo Gao authored Mar 26, 2021
  
  bc5478a1
- Fix stuff and make tests pass · c971fa82
  Leo Gao authored Mar 26, 2021
  
  c971fa82
26 Mar, 2021 3 commits
- Add Reorderer and implement in gpt2 and gpt3 · 8e8d7c6d
  Leo Gao authored Mar 26, 2021
  
  8e8d7c6d
- More changes to make neo work · 1b4242c1
  Leo Gao authored Mar 26, 2021
  
  1b4242c1
- Update GPT2LM to handle neo based models as well · 747b851d
  Leo Gao authored Mar 26, 2021
  
  747b851d
06 Mar, 2021 1 commit
- Flag down a bunch of todos · 491283c5
  Leo Gao authored Mar 05, 2021
  
  491283c5
23 Feb, 2021 1 commit
- Fix translation context · ba9c13b2
  Leo Gao authored Feb 22, 2021
  
  ba9c13b2
21 Feb, 2021 2 commits
- Fix gpt3 batching bug · 03f34463
  Leo Gao authored Feb 20, 2021
  
  03f34463
- Add gpt3 chunking · 1ff4e07f
  Leo Gao authored Feb 20, 2021
  
  1ff4e07f
19 Feb, 2021 1 commit
- Add gpt2/3 tokenizer sanity check · 77b44470
  Leo Gao authored Feb 18, 2021
  
  77b44470
14 Feb, 2021 1 commit
- Add GPT2 greedy_until truncation · 8966289a
  Leo Gao authored Feb 14, 2021
  
  8966289a
11 Feb, 2021 3 commits
- Fixes to make greedy_until work · 432bd44c
  Leo Gao authored Feb 10, 2021
```
# Conflicts:
#	lm_eval/models/gpt2.py
#	lm_eval/tasks/squad.py
```
  432bd44c
- Fixes to make greedy_until work · 7b649ded
  Leo Gao authored Feb 10, 2021
  
  7b649ded
- Implement GPT2 greedy_until · e8f9dc71
  Leo Gao authored Feb 10, 2021
  
  e8f9dc71
10 Feb, 2021 1 commit
- Update gpt2 for efficiency and allow specifying model size · aab91285
  Leo Gao authored Feb 09, 2021
  
  aab91285
08 Feb, 2021 1 commit
- LM: handle empty context · 359114fd
  Leo Gao authored Feb 07, 2021
  
  359114fd
05 Feb, 2021 2 commits
- Add retry with backoff for GPT3 · b1f7284e
  Leo Gao authored Feb 04, 2021
  
  b1f7284e
- Get rid of annoying logging · c55e8237
  Leo Gao authored Feb 04, 2021
  
  c55e8237
04 Feb, 2021 4 commits
- Add missing import · 1815286c
  Leo Gao authored Feb 03, 2021
  
  1815286c
- Implement gpt3 greedy_until · 5f4c7c50
  Leo Gao authored Feb 03, 2021
  
  5f4c7c50
- Massive refactor · 778e0f91
  Leo Gao authored Feb 03, 2021
```
- Extract evaluator (still needs work to clean up)
- Add tests for evaluator
- Fix all the things that break on the new tests
- Misc cleanup
```
  778e0f91
- Implement gpt3 logprobs · 52c1c56a
  Leo Gao authored Feb 03, 2021
  
  52c1c56a
01 Feb, 2021 1 commit
- Fix linting problems · fe4a1efd
  Leo Gao authored Feb 01, 2021
  
  fe4a1efd
28 Jan, 2021 1 commit
- Implement unit testing and fix lots of problems with tasks · 60a6fd8c
  Leo Gao authored Jan 27, 2021
  
  60a6fd8c
22 Jan, 2021 2 commits
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
- Implement isgreedy · e723d3d5
  Leo Gao authored Jan 21, 2021
  
  e723d3d5
09 Jan, 2021 1 commit
- Refactor and implement SAT evaluation · 0f9c1624
  Leo Gao authored Jan 08, 2021
  
  0f9c1624
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
03 Jan, 2021 1 commit
- Fix memory problem · f298ca76
  Leo Gao authored Jan 03, 2021
  
  f298ca76