csrc/quantization/gguf/gguf_kernel.cu · 1a45a61387be295c969c620458b7ef4a13250ed2 · OpenDAS / vllm_cscc

[Kernel] GGUF MoeVec kernel (#16780) · 1a45a613

Szymon Ożóg authored May 07, 2025


Signed-off-by: SzymonOzog <szymon.ozog@aleph-alpha.com>
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

1a45a613

gguf_kernel.cu 21.5 KB

Replace gguf_kernel.cu