---
id: pr-deepgemm-95
repo: deepseek-ai/DeepGEMM
pr: 95
title: Weight gradient kernels for dense and MoE models
author: zheanxu
date: '2025-05-14'
url: https://github.com/deepseek-ai/DeepGEMM/pull/95
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- compiler_runtime
- fp8
- gemm
- gemm_quant
- grouped gemm
- moe
- moe_routing
techniques:
- fine-grained-quantization
hardware_features:
- fp8
kernel_types:
- compiler
- gemm
- moe
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 04278f6dee2a7b9da5d881fa40b24ad27dfac0f6
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- README.md
- deep_gemm/__init__.py
- deep_gemm/include/deep_gemm/fp8_gemm.cuh
- deep_gemm/include/deep_gemm/fp8_wgrad_gemm.cuh
- deep_gemm/include/deep_gemm/mma_utils.cuh
- deep_gemm/jit_kernels/__init__.py
- deep_gemm/jit_kernels/gemm.py
- deep_gemm/jit_kernels/m_grouped_gemm.py
- deep_gemm/jit_kernels/runtime.py
- deep_gemm/jit_kernels/wgrad_gemm.py
- deep_gemm/utils.py
- tests/test_core.py
artifact_dir: evidence/pull-bundles/deepgemm/gh-95
head_ref_oid: a6ced6f2079003934c7993457ac1585859043de8
---
# Weight gradient kernels for dense and MoE models

- Repository: `deepseek-ai/DeepGEMM`
- PR: [95](https://github.com/deepseek-ai/DeepGEMM/pull/95)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `README.md`
- `deep_gemm/__init__.py`
- `deep_gemm/include/deep_gemm/fp8_gemm.cuh`
- `deep_gemm/include/deep_gemm/fp8_wgrad_gemm.cuh`
- `deep_gemm/include/deep_gemm/mma_utils.cuh`
- `deep_gemm/jit_kernels/__init__.py`
- `deep_gemm/jit_kernels/gemm.py`
- `deep_gemm/jit_kernels/m_grouped_gemm.py`
- `deep_gemm/jit_kernels/runtime.py`
- `deep_gemm/jit_kernels/wgrad_gemm.py`
- `deep_gemm/utils.py`
- `tests/test_core.py`

## Evidence Bundle

`evidence/pull-bundles/deepgemm/gh-95`
