Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
18511aed
Unverified
Commit
18511aed
authored
Oct 10, 2024
by
Lucas Wilkinson
Committed by
GitHub
Oct 10, 2024
Browse files
[Bugfix] Fix Machete unittests failing with `NotImplementedError` (#9218)
parent
83ea5c72
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
csrc/quantization/machete/machete_pytorch.cu
csrc/quantization/machete/machete_pytorch.cu
+4
-0
No files found.
csrc/quantization/machete/machete_pytorch.cu
View file @
18511aed
...
@@ -89,6 +89,10 @@ torch::Tensor prepack_B(torch::Tensor const& B,
...
@@ -89,6 +89,10 @@ torch::Tensor prepack_B(torch::Tensor const& B,
TORCH_LIBRARY_IMPL_EXPAND
(
TORCH_EXTENSION_NAME
,
CUDA
,
m
)
{
TORCH_LIBRARY_IMPL_EXPAND
(
TORCH_EXTENSION_NAME
,
CUDA
,
m
)
{
m
.
impl
(
"machete_prepack_B"
,
&
prepack_B
);
m
.
impl
(
"machete_prepack_B"
,
&
prepack_B
);
m
.
impl
(
"machete_gemm"
,
&
gemm
);
m
.
impl
(
"machete_gemm"
,
&
gemm
);
}
// use CatchAll since supported_schedules has no tensor arguments
TORCH_LIBRARY_IMPL
(
TORCH_EXTENSION_NAME
,
CatchAll
,
m
)
{
m
.
impl
(
"machete_supported_schedules"
,
&
supported_schedules
);
m
.
impl
(
"machete_supported_schedules"
,
&
supported_schedules
);
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment