"...git@developer.sourcefind.cn:OpenDAS/TransformerEngine.git" did not exist on "8f6c52485adb55c07d92e067d3de7ed6b4bc3615"
Unverified Commit 964c2ed2 authored by Paweł Gadziński's avatar Paweł Gadziński Committed by GitHub
Browse files

[PyTorch Debug] Fix the issue with PP (#1894)



* fix
Signed-off-by: default avatarPawel Gadzinski <pgadzinski@nvidia.com>

* fix
Signed-off-by: default avatarPawel Gadzinski <pgadzinski@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci



---------
Signed-off-by: default avatarPawel Gadzinski <pgadzinski@nvidia.com>
Co-authored-by: default avatarpre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
parent 23cf4ff9
...@@ -62,6 +62,12 @@ class DebugQuantizer(Quantizer): ...@@ -62,6 +62,12 @@ class DebugQuantizer(Quantizer):
self.tp_group = tp_group # used in inspect_tensor calls self.tp_group = tp_group # used in inspect_tensor calls
self.iteration = debug_api.DEBUG_MANAGER._trainer_iteration_count self.iteration = debug_api.DEBUG_MANAGER._trainer_iteration_count
# .internal = True is slightly faster, but results
# in errors when caching the weights.
# Setting .internal = False is safer.
if parent_quantizer is not None:
parent_quantizer.internal = False
self.rowwise_gemm_name, self.columnwise_gemm_name = _tensor_to_gemm_names_map[tensor_name] self.rowwise_gemm_name, self.columnwise_gemm_name = _tensor_to_gemm_names_map[tensor_name]
# The values of the inspect_tensor_enabled, inspect_tensor_postquantize_enabled, # The values of the inspect_tensor_enabled, inspect_tensor_postquantize_enabled,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment