---
id: pr-deepgemm-112
repo: deepseek-ai/DeepGEMM
pr: 112
title: Add more GPU architectures support
author: RayWang96
date: '2025-07-18'
url: https://github.com/deepseek-ai/DeepGEMM/pull/112
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- TMA
- arch_pipeline
- benchmark
- blackwell
- fp8
- gemm
- gemm_quant
- grouped gemm
- hopper
- memory_primitives
- scheduler_autotune
- sm100
- sm90
techniques:
- async-copy
- autotuning
- cache-policy
- fine-grained-quantization
- pipeline-stages
- tile-scheduling
hardware_features:
- blackwell
- fp8
- hopper
- tma
kernel_types:
- gemm
- memory
- runtime
- scheduler
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 9da4a23561e114d192e25e893f16358d68b04da3
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- .gitmodules
- CMakeLists.txt
- README.md
- csrc/indexing/main.cu
- csrc/jit/cache.hpp
- csrc/jit/compiler.hpp
- csrc/jit/device_runtime.hpp
- csrc/jit/kernel_runtime.hpp
- csrc/jit_kernels/heuristics/common.hpp
- csrc/jit_kernels/heuristics/sm100.hpp
- csrc/jit_kernels/heuristics/sm90.hpp
- csrc/jit_kernels/impls/runtime_utils.hpp
- csrc/jit_kernels/impls/sm100_fp8_gemm_1d1d.hpp
- csrc/jit_kernels/impls/sm100_fp8_gemm_1d2d.hpp
- csrc/jit_kernels/impls/sm90_fp8_gemm_1d2d.hpp
- csrc/jit_kernels/impls/smxx_layout.hpp
- csrc/python_api.cpp
- csrc/utils/exception.hpp
- csrc/utils/format.hpp
- csrc/utils/hash.hpp
- csrc/utils/layout.hpp
- csrc/utils/math.hpp
- csrc/utils/system.hpp
- deep_gemm/__init__.py
- deep_gemm/include/deep_gemm/common/scheduler.cuh
- deep_gemm/include/deep_gemm/common/sm100_utils.cuh
- deep_gemm/include/deep_gemm/common/sm90_utils.cuh
- deep_gemm/include/deep_gemm/common/types.hpp
- deep_gemm/include/deep_gemm/common/utils.cuh
- deep_gemm/include/deep_gemm/fp8_wgrad_gemm.cuh
- deep_gemm/include/deep_gemm/impls/sm100_bf16_gemm.cuh
- deep_gemm/include/deep_gemm/impls/sm100_fp8_gemm_1d1d.cuh
- deep_gemm/include/deep_gemm/impls/sm100_fp8_gemm_1d2d.cuh
- deep_gemm/include/deep_gemm/impls/sm90_bf16_gemm.cuh
- deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d1d.cuh
- deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh
- deep_gemm/include/deep_gemm/impls/smxx_layout.cuh
- deep_gemm/include/deep_gemm/scheduler.cuh
- deep_gemm/include/deep_gemm/tma_utils.cuh
- deep_gemm/include/deep_gemm/utils.cuh
- deep_gemm/jit/__init__.py
- deep_gemm/jit/compiler.py
- deep_gemm/jit/interleave_ffma.py
- deep_gemm/jit/runtime.py
- deep_gemm/jit_kernels/__init__.py
- deep_gemm/jit_kernels/gemm.py
- deep_gemm/jit_kernels/m_grouped_gemm.py
- deep_gemm/jit_kernels/runtime.py
- deep_gemm/jit_kernels/utils.py
- deep_gemm/jit_kernels/wgrad_gemm.py
- deep_gemm/testing/__init__.py
- deep_gemm/testing/bench.py
- deep_gemm/testing/numeric.py
- deep_gemm/utils/__init__.py
- deep_gemm/utils/layout.py
- deep_gemm/utils/math.py
- develop.sh
- figures/design.png
- indexing/main.cu
- install.sh
- setup.py
- tests/generators.py
- tests/test_core.py
- tests/test_jit.py
- tests/test_layout.py
- third-party/cutlass
- third-party/fmt
artifact_dir: evidence/pull-bundles/deepgemm/gh-112
head_ref_oid: 4c4ff2e4ffcdbd8ddac3fb1f9c8caccec27f932a
---
# Add more GPU architectures support

- Repository: `deepseek-ai/DeepGEMM`
- PR: [112](https://github.com/deepseek-ai/DeepGEMM/pull/112)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `.gitmodules`
- `CMakeLists.txt`
- `README.md`
- `csrc/indexing/main.cu`
- `csrc/jit/cache.hpp`
- `csrc/jit/compiler.hpp`
- `csrc/jit/device_runtime.hpp`
- `csrc/jit/kernel_runtime.hpp`
- `csrc/jit_kernels/heuristics/common.hpp`
- `csrc/jit_kernels/heuristics/sm100.hpp`
- `csrc/jit_kernels/heuristics/sm90.hpp`
- `csrc/jit_kernels/impls/runtime_utils.hpp`
- `csrc/jit_kernels/impls/sm100_fp8_gemm_1d1d.hpp`
- `csrc/jit_kernels/impls/sm100_fp8_gemm_1d2d.hpp`
- `csrc/jit_kernels/impls/sm90_fp8_gemm_1d2d.hpp`
- `csrc/jit_kernels/impls/smxx_layout.hpp`
- `csrc/python_api.cpp`
- `csrc/utils/exception.hpp`
- `csrc/utils/format.hpp`
- `csrc/utils/hash.hpp`
- `csrc/utils/layout.hpp`
- `csrc/utils/math.hpp`
- `csrc/utils/system.hpp`
- `deep_gemm/__init__.py`
- `deep_gemm/include/deep_gemm/common/scheduler.cuh`
- `deep_gemm/include/deep_gemm/common/sm100_utils.cuh`
- `deep_gemm/include/deep_gemm/common/sm90_utils.cuh`
- `deep_gemm/include/deep_gemm/common/types.hpp`
- `deep_gemm/include/deep_gemm/common/utils.cuh`
- `deep_gemm/include/deep_gemm/fp8_wgrad_gemm.cuh`
- `deep_gemm/include/deep_gemm/impls/sm100_bf16_gemm.cuh`
- `deep_gemm/include/deep_gemm/impls/sm100_fp8_gemm_1d1d.cuh`
- `deep_gemm/include/deep_gemm/impls/sm100_fp8_gemm_1d2d.cuh`
- `deep_gemm/include/deep_gemm/impls/sm90_bf16_gemm.cuh`
- `deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d1d.cuh`
- `deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh`
- `deep_gemm/include/deep_gemm/impls/smxx_layout.cuh`
- `deep_gemm/include/deep_gemm/scheduler.cuh`
- `deep_gemm/include/deep_gemm/tma_utils.cuh`
- `deep_gemm/include/deep_gemm/utils.cuh`
- `deep_gemm/jit/__init__.py`
- `deep_gemm/jit/compiler.py`
- `deep_gemm/jit/interleave_ffma.py`
- `deep_gemm/jit/runtime.py`
- `deep_gemm/jit_kernels/__init__.py`
- `deep_gemm/jit_kernels/gemm.py`
- `deep_gemm/jit_kernels/m_grouped_gemm.py`
- `deep_gemm/jit_kernels/runtime.py`
- `deep_gemm/jit_kernels/utils.py`
- `deep_gemm/jit_kernels/wgrad_gemm.py`
- `deep_gemm/testing/__init__.py`
- `deep_gemm/testing/bench.py`
- `deep_gemm/testing/numeric.py`
- `deep_gemm/utils/__init__.py`
- `deep_gemm/utils/layout.py`
- `deep_gemm/utils/math.py`
- `develop.sh`
- `figures/design.png`
- `indexing/main.cu`
- `install.sh`
- `setup.py`
- `tests/generators.py`
- `tests/test_core.py`
- `tests/test_jit.py`
- `tests/test_layout.py`
- `third-party/cutlass`
- `third-party/fmt`

## Evidence Bundle

`evidence/pull-bundles/deepgemm/gh-112`
