---
id: pr-quack-19
repo: Dao-AILab/quack
pr: 19
title: add PyTorch focused benchmarking for quack rmsnorm
author: lessw2020
date: '2025-07-17'
url: https://github.com/Dao-AILab/quack/pull/19
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark kernel
- norm
- quack
- triton kernel
techniques: []
hardware_features: []
kernel_types:
- norm
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 3ce89a2403357c912a5ebc6d83751f13adddcfd5
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- benchmarks/pytorch_benchmark_rmsnorm.py
- benchmarks/pytorch_benchmark_rmsnorm_backward.py
- benchmarks/visual_outputs/quack_vs_pytorch_backward_speedup.png
- benchmarks/visual_outputs/quack_vs_pytorch_speedup.png
- benchmarks/visual_outputs/quack_vs_torchcompile_backward_speedup.png
- benchmarks/visual_outputs/quack_vs_torchcompile_speedup.png
- benchmarks/visual_outputs/rmsnorm_backward_speedup_comparison.png
- benchmarks/visual_outputs/rmsnorm_speedup_comparison.png
artifact_dir: evidence/pull-bundles/quack/gh-19
head_ref_oid: 670a9df15f68868f90acc7a54375748887fe987f
---
# add PyTorch focused benchmarking for quack rmsnorm

- Repository: `Dao-AILab/quack`
- PR: [19](https://github.com/Dao-AILab/quack/pull/19)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `benchmarks/pytorch_benchmark_rmsnorm.py`
- `benchmarks/pytorch_benchmark_rmsnorm_backward.py`
- `benchmarks/visual_outputs/quack_vs_pytorch_backward_speedup.png`
- `benchmarks/visual_outputs/quack_vs_pytorch_speedup.png`
- `benchmarks/visual_outputs/quack_vs_torchcompile_backward_speedup.png`
- `benchmarks/visual_outputs/quack_vs_torchcompile_speedup.png`
- `benchmarks/visual_outputs/rmsnorm_backward_speedup_comparison.png`
- `benchmarks/visual_outputs/rmsnorm_speedup_comparison.png`

## Evidence Bundle

`evidence/pull-bundles/quack/gh-19`
