Skip to content

GitLab

Commit a7d6cb2d authored by Benjamin Fattori's avatar Benjamin Fattori
Browse files

record _rank/_world_size for single GPU

parent eddd627a
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
lm_eval/models/gpt2.py
View file @ a7d6cb2d
...@@ -44,6 +44,8 @@ class HFLM(LM): ...@@ -44,6 +44,8 @@ class HFLM(LM):
if torch.cuda.is_available() if torch.cuda.is_available()
else torch.device("cpu") else torch.device("cpu")
) )
self._rank = 0
self._world_size = 1
else: else:
self._device = 'cpu' self._device = 'cpu'
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment