Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
DeepEP
Commits
c78b9ed7
Unverified
Commit
c78b9ed7
authored
Sep 01, 2025
by
fzyzcjy
Committed by
GitHub
Sep 01, 2025
Browse files
Update internode_ll.cu (#376)
parent
b7fef496
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
csrc/kernels/internode_ll.cu
csrc/kernels/internode_ll.cu
+1
-1
No files found.
csrc/kernels/internode_ll.cu
View file @
c78b9ed7
...
@@ -72,7 +72,7 @@ dispatch(void* packed_recv_x, void* packed_recv_x_scales,
...
@@ -72,7 +72,7 @@ dispatch(void* packed_recv_x, void* packed_recv_x_scales,
const
size_t
hidden_bytes
=
kHidden
*
(
kUseFP8
?
sizeof
(
__nv_fp8_storage_t
)
:
sizeof
(
nv_bfloat16
));
const
size_t
hidden_bytes
=
kHidden
*
(
kUseFP8
?
sizeof
(
__nv_fp8_storage_t
)
:
sizeof
(
nv_bfloat16
));
const
size_t
hidden_int4
=
hidden_bytes
/
sizeof
(
int4
);
const
size_t
hidden_int4
=
hidden_bytes
/
sizeof
(
int4
);
// Message package: hidden data, FP8 scales
, index at source
// Message package:
index at source (int), 3 reserved int fields,
hidden data, FP8 scales
// NOTES: currently we have 3 reserved int fields for future use
// NOTES: currently we have 3 reserved int fields for future use
using
vec_t
=
std
::
conditional_t
<
kUseFP8
,
int2
,
int4
>
;
using
vec_t
=
std
::
conditional_t
<
kUseFP8
,
int2
,
int4
>
;
const
size_t
num_bytes_per_msg
=
sizeof
(
int4
)
+
(
kUseFP8
?
(
kHidden
+
num_scales
*
sizeof
(
float
))
:
(
kHidden
*
sizeof
(
nv_bfloat16
)));
const
size_t
num_bytes_per_msg
=
sizeof
(
int4
)
+
(
kUseFP8
?
(
kHidden
+
num_scales
*
sizeof
(
float
))
:
(
kHidden
*
sizeof
(
nv_bfloat16
)));
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment