Unverified Commit 9d07d756 authored by Emmanuel Kahembwe's avatar Emmanuel Kahembwe Committed by GitHub
Browse files

NameError: name 'mpu' is not defined (#305)

mpu object is bound to the class instance.. 

the if statement uses  `self.mpu'  but just `mpu` is called in the following lines.. 

This raises a NameError
parent e50b8838
...@@ -650,8 +650,8 @@ class DeepSpeedLight(Module): ...@@ -650,8 +650,8 @@ class DeepSpeedLight(Module):
data_parallel_world_size = None data_parallel_world_size = None
data_parallel_rank = None data_parallel_rank = None
if self.mpu is not None: if self.mpu is not None:
data_parallel_world_size = mpu.get_data_parallel_world_size() data_parallel_world_size = self.mpu.get_data_parallel_world_size()
data_parallel_rank = mpu.get_data_parallel_rank() data_parallel_rank = self.mpu.get_data_parallel_rank()
return DeepSpeedDataLoader(dataset=dataset, return DeepSpeedDataLoader(dataset=dataset,
batch_size=batch_size, batch_size=batch_size,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment