"megatron/inference/text_generation/communication.py" did not exist on "a7539b0f863d0a5fc8acea8e4944ef76f2493a9f"
-
Daniel Hiltgen authored
We're seeing some corner cases with cudart which might be resolved by switching to the driver API which comes bundled with the driver package
089daaea