Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
5c1e496a
Unverified
Commit
5c1e496a
authored
Sep 24, 2025
by
Shiyan Deng
Committed by
GitHub
Sep 24, 2025
Browse files
[MISC] replace c10::optional with std::optional (#25602)
Signed-off-by:
Shiyan Deng
<
dsy842974287@meta.com
>
parent
e7f27ea6
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
csrc/rocm/ops.h
csrc/rocm/ops.h
+2
-2
csrc/rocm/skinny_gemms.cu
csrc/rocm/skinny_gemms.cu
+2
-2
No files found.
csrc/rocm/ops.h
View file @
5c1e496a
...
...
@@ -6,11 +6,11 @@ torch::Tensor LLMM1(at::Tensor& in_a, at::Tensor& in_b,
const
int64_t
rows_per_block
);
torch
::
Tensor
wvSplitK
(
const
at
::
Tensor
&
in_a
,
const
at
::
Tensor
&
in_b
,
const
c10
::
optional
<
at
::
Tensor
>&
in_bias
,
const
std
::
optional
<
at
::
Tensor
>&
in_bias
,
const
int64_t
CuCount
);
void
wvSplitKQ
(
const
at
::
Tensor
&
in_a
,
const
at
::
Tensor
&
in_b
,
const
c10
::
optional
<
at
::
Tensor
>&
in_bias
,
at
::
Tensor
&
out_c
,
const
std
::
optional
<
at
::
Tensor
>&
in_bias
,
at
::
Tensor
&
out_c
,
const
at
::
Tensor
&
scale_a
,
const
at
::
Tensor
&
scale_b
,
const
int64_t
CuCount
);
...
...
csrc/rocm/skinny_gemms.cu
View file @
5c1e496a
...
...
@@ -1271,7 +1271,7 @@ int mindiv(int N, int div1, int div2) {
}
torch
::
Tensor
wvSplitK
(
const
at
::
Tensor
&
in_a
,
const
at
::
Tensor
&
in_b
,
const
c10
::
optional
<
at
::
Tensor
>&
in_bias
,
const
std
::
optional
<
at
::
Tensor
>&
in_bias
,
const
int64_t
CuCount
)
{
auto
M_in
=
in_a
.
size
(
0
);
auto
K_in
=
in_a
.
size
(
1
);
...
...
@@ -1729,7 +1729,7 @@ __global__ void wvSplitKQ_hf_(const int K, const int Kp, const int M,
#endif // defined(__HIP__MI3XX__) TODO: Add NAVI support
void
wvSplitKQ
(
const
at
::
Tensor
&
in_a
,
const
at
::
Tensor
&
in_b
,
const
c10
::
optional
<
at
::
Tensor
>&
in_bias
,
at
::
Tensor
&
out_c
,
const
std
::
optional
<
at
::
Tensor
>&
in_bias
,
at
::
Tensor
&
out_c
,
const
at
::
Tensor
&
scale_a
,
const
at
::
Tensor
&
scale_b
,
const
int64_t
CuCount
)
{
static
c10
::
ScalarType
kFp8Type
=
is_fp8_ocp
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment