Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
TransformerEngine
Commits
16de530e
Commit
16de530e
authored
Apr 29, 2025
by
yuguo
Browse files
[DCU] fix fsdp2
parent
11b6b7e4
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
tests/pytorch/distributed/run_fsdp2_model.py
tests/pytorch/distributed/run_fsdp2_model.py
+2
-2
tests/pytorch/distributed/test_torch_fsdp2.py
tests/pytorch/distributed/test_torch_fsdp2.py
+1
-1
No files found.
tests/pytorch/distributed/run_fsdp2_model.py
View file @
16de530e
...
...
@@ -8,8 +8,6 @@ import os
import
sys
import
argparse
import
transformer_engine.pytorch
as
te
from
transformer_engine.common.recipe
import
Format
,
DelayedScaling
import
torch
import
torch.distributed
as
dist
...
...
@@ -20,6 +18,8 @@ from torch.distributed._composable.fsdp import fully_shard
from
torch.distributed.device_mesh
import
init_device_mesh
from
contextlib
import
nullcontext
import
transformer_engine.pytorch
as
te
from
transformer_engine.common.recipe
import
Format
,
DelayedScaling
class
SimpleNet
(
nn
.
Module
):
def
__init__
(
self
,
input_size
,
hidden_size
,
output_size
):
...
...
tests/pytorch/distributed/test_torch_fsdp2.py
View file @
16de530e
...
...
@@ -6,10 +6,10 @@ import os
import
pytest
import
subprocess
from
pathlib
import
Path
import
torch
from
transformer_engine.pytorch
import
torch_version
from
transformer_engine.pytorch.fp8
import
FP8GlobalStateManager
import
torch
fp8_available
,
reason_for_no_fp8
=
FP8GlobalStateManager
.
is_fp8_available
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment