---
id: pr-quack-16
repo: Dao-AILab/quack
pr: 16
title: Add RMSNorm support for BF16 and FP16 weights, add unit tests to verify BF16, FP16 weight results for fwd, bwd
author: lessw2020
date: '2025-07-16'
url: https://github.com/Dao-AILab/quack/pull/16
source_category: upstream-code
architectures:
- sm100
tags:
- cute
- cute-dsl
techniques: []
hardware_features: []
kernel_types:
- norm
languages:
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: d0068500af9ee7e1a58add5e276cdafe0a71b1fc
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- quack/rmsnorm.py
- tests/test_rmsnorm.py
artifact_dir: evidence/pull-bundles/quack/gh-16
head_ref_oid: 9e7b43b22f650021862553aae9d5c069e4faf8fc
---
# Add RMSNorm support for BF16 and FP16 weights, add unit tests to verify BF16, FP16 weight results for fwd, bwd

- Repository: `Dao-AILab/quack`
- PR: [16](https://github.com/Dao-AILab/quack/pull/16)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `quack/rmsnorm.py`
- `tests/test_rmsnorm.py`

## Evidence Bundle

`evidence/pull-bundles/quack/gh-16`
