Commits · f8342178d4da8bccc874df110850ff7b4eceb89b · gaoqiong / lm-evaluation-harness

13 Sep, 2023 1 commit
- Update device list and dtype detection for MPS · bd81b8c0
  baberabb authored Sep 14, 2023
  
  bd81b8c0
25 Aug, 2023 1 commit

Add suggestions from autotyping · fc69d84f

Ethan Smith authored Aug 25, 2023

This adds a bunch of simple annotations suggested by https://github.com/JelleZijlstra/autotyping.

fc69d84f

07 Aug, 2023 1 commit
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
16 Jul, 2023 2 commits
- set fp32 if device=mps · 43407f36
  baberabb authored Jul 16, 2023
  
  43407f36
- set fp32 if device=mps · ce214979
  baberabb authored Jul 16, 2023
  
  ce214979
28 Jun, 2023 4 commits
- make self.rank and world_size defaults more robust · 8762b07c
  haileyschoelkopf authored Jun 28, 2023
  
  8762b07c
- make cache-loading msg part of logger · 7ffb74ce
  haileyschoelkopf authored Jun 28, 2023
  
  7ffb74ce
- Update model.py · b2fb53d4
  Hailey Schoelkopf authored Jun 28, 2023
  
  b2fb53d4
- Add tqdm progress bar for cachingLM · f95b160b
  Hailey Schoelkopf authored Jun 28, 2023
  
  f95b160b
23 Jun, 2023 1 commit
- add CachingLM back · 1c0ff968
  haileyschoelkopf authored Jun 23, 2023
  
  1c0ff968
19 Jun, 2023 1 commit
- misc fixes · 3f0afe02
  haileyschoelkopf authored Jun 19, 2023
  
  3f0afe02
07 Jun, 2023 1 commit
- MODEL_REGISTRY to registry.py · f2166089
  lintangsutawika authored Jun 07, 2023
  
  f2166089
19 May, 2023 1 commit
- pre-commit stuff · c4c20ff5
  lintangsutawika authored May 19, 2023
  
  c4c20ff5
02 May, 2023 1 commit
- prelim. multiple choice support · 487f7811
  haileyschoelkopf authored May 02, 2023
  
  487f7811
24 Apr, 2023 1 commit
- make tasks and models registered by decorators · f275301a
  haileyschoelkopf authored Apr 23, 2023
  
  f275301a
19 Apr, 2023 1 commit
- in-place replace main with lm-eval2, keeping old git history · d2a9b759
  haileyschoelkopf authored Apr 19, 2023
  
  d2a9b759