Skip to content

GitLab

"...text-generation-inference.git" did not exist on "04d4765bad5707458955189fbf39e8b485de5cbd"
Commit 38ea0e90 authored by Pooya Davoodi's avatar Pooya Davoodi
Browse files

Read world_size argument in multiproc if specified in argslist

parent ea93767d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
apex/parallel/multiproc.py
View file @ 38ea0e90
...@@ -13,7 +13,7 @@ argslist = list(sys.argv)[1:] ...@@ -13,7 +13,7 @@ argslist = list(sys.argv)[1:]
world_size = torch.cuda.device_count() world_size = torch.cuda.device_count()
if '--world-size' in argslist: if '--world-size' in argslist:
argslist[argslist.index('--world-size')+1] = str(world_size) world_size = int(argslist[argslist.index('--world-size')+1])
else: else:
argslist.append('--world-size') argslist.append('--world-size')
argslist.append(str(world_size)) argslist.append(str(world_size))
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment