Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
cbf780d0
Commit
cbf780d0
authored
Sep 26, 2022
by
Jared Casper
Browse files
Update exports.
parent
e00a1ca1
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
0 deletions
+3
-0
megatron/core/tensor_parallel/__init__.py
megatron/core/tensor_parallel/__init__.py
+3
-0
No files found.
megatron/core/tensor_parallel/__init__.py
View file @
cbf780d0
...
...
@@ -42,6 +42,7 @@ __all__ = [
"ColumnParallelLinear"
,
"RowParallelLinear"
,
"VocabParallelEmbedding"
,
"set_tensor_model_parallel_attributes"
,
"set_defaults_if_not_set_tensor_model_parallel_attributes"
,
"copy_tensor_model_parallel_attributes"
,
"param_is_not_tensor_parallel_duplicate"
,
...
...
@@ -59,4 +60,6 @@ __all__ = [
"model_parallel_cuda_manual_seed"
,
# utils.py
"split_tensor_along_last_dim"
,
"split_tensor_into_1d_equal_chunks"
,
"gather_split_1d_tensor"
,
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment