---
id: pr-vllm-11698
repo: vllm-project/vllm
pr: 11698
title: '[Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models'
author: rasmith
date: '2025-01-08'
url: https://github.com/vllm-project/vllm/pull/11698
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 526de822d501c792b051c864ba873a836d78d5bf
inclusion_reason: defer
changed_paths:
- vllm/model_executor/layers/quantization/compressed_tensors/triton_scaled_mm.py
artifact_dir: evidence/pull-bundles/vllm/gh-11698
head_ref_oid: eb8126ef5a7c45c9e24d9d9570243c81eb75e1e7
---
# [Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models

- Repository: `vllm-project/vllm`
- PR: [11698](https://github.com/vllm-project/vllm/pull/11698)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `vllm/model_executor/layers/quantization/compressed_tensors/triton_scaled_mm.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-11698`
