Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
1951f7fa
Commit
1951f7fa
authored
Jan 09, 2023
by
oahzxl
Browse files
code style
parent
212b5b1b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
6 deletions
+8
-6
colossalai/autochunk/autochunk_codegen.py
colossalai/autochunk/autochunk_codegen.py
+8
-6
No files found.
colossalai/autochunk/autochunk_codegen.py
View file @
1951f7fa
...
@@ -137,9 +137,9 @@ def emit_code_with_chunk(
...
@@ -137,9 +137,9 @@ def emit_code_with_chunk(
):
):
"""
"""
Emit code with chunk according to chunk_infos.
Emit code with chunk according to chunk_infos.
It will generate a for loop in chunk regions, and
replace inputs
It will generate a for loop in chunk regions, and
and outputs of regions with chunked variables.
replace inputs
and outputs of regions with chunked variables.
Args:
Args:
body: forward code
body: forward code
...
@@ -156,9 +156,11 @@ def emit_code_with_chunk(
...
@@ -156,9 +156,11 @@ def emit_code_with_chunk(
chunk_ends
=
[
i
[
"region"
][
1
]
for
i
in
chunk_infos
]
chunk_ends
=
[
i
[
"region"
][
1
]
for
i
in
chunk_infos
]
# chunk inputs
# chunk inputs
chunk_inputs
=
[
i
[
"inputs"
]
for
i
in
chunk_infos
]
# input with chunk
chunk_inputs
=
[
i
[
"inputs"
]
for
i
in
chunk_infos
]
# input with chunk
chunk_inputs_non_chunk
=
[
i
[
"inputs_non_chunk"
]
for
i
in
chunk_infos
]
# input without chunk
chunk_inputs_non_chunk
=
[
chunk_inputs_dim
=
[
i
[
"inputs_dim"
]
for
i
in
chunk_infos
]
# input chunk dim
i
[
"inputs_non_chunk"
]
for
i
in
chunk_infos
]
# input without chunk
chunk_inputs_dim
=
[
i
[
"inputs_dim"
]
for
i
in
chunk_infos
]
# input chunk dim
chunk_inputs_names
=
[
j
.
name
for
i
in
chunk_inputs
for
j
in
i
]
+
[
chunk_inputs_names
=
[
j
.
name
for
i
in
chunk_inputs
for
j
in
i
]
+
[
j
.
name
for
i
in
chunk_inputs_non_chunk
for
j
in
i
j
.
name
for
i
in
chunk_inputs_non_chunk
for
j
in
i
]
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment