Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
bc7b3539
Commit
bc7b3539
authored
Aug 22, 2021
by
mshoeybi
Browse files
removed unused variable
parent
b0b017ff
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
1 deletion
+0
-1
megatron/fused_kernels/scaled_masked_softmax.h
megatron/fused_kernels/scaled_masked_softmax.h
+0
-1
No files found.
megatron/fused_kernels/scaled_masked_softmax.h
View file @
bc7b3539
...
@@ -316,7 +316,6 @@ int get_batch_per_block(int query_seq_len, int key_seq_len, int batches, int att
...
@@ -316,7 +316,6 @@ int get_batch_per_block(int query_seq_len, int key_seq_len, int batches, int att
int
log2_elements
=
log2_ceil
(
key_seq_len
);
int
log2_elements
=
log2_ceil
(
key_seq_len
);
const
int
next_power_of_two
=
1
<<
log2_elements
;
const
int
next_power_of_two
=
1
<<
log2_elements
;
int
batch_count
=
batches
*
attn_heads
*
query_seq_len
;
int
warp_size
=
(
next_power_of_two
<
C10_WARP_SIZE
)
?
next_power_of_two
:
C10_WARP_SIZE
;
int
warp_size
=
(
next_power_of_two
<
C10_WARP_SIZE
)
?
next_power_of_two
:
C10_WARP_SIZE
;
int
batches_per_warp
=
(
next_power_of_two
<=
128
)
?
2
:
1
;
int
batches_per_warp
=
(
next_power_of_two
<=
128
)
?
2
:
1
;
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment