---
id: pr-vllm-35733
repo: vllm-project/vllm
pr: 35733
title: '[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on AMD Instinct MI300, MI355X and Hopper through emulation'
author: fxmarty-amd
date: '2026-04-06'
url: https://github.com/vllm-project/vllm/pull/35733
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- fp4
- nvfp4
- quantization
techniques: []
hardware_features:
- fp4
- nvfp4
kernel_types:
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: 00d7b497b33679a3ce641db9119eb09dd4ed5e30
inclusion_reason: kernel file changes
changed_paths:
- tests/models/quantization/test_nvfp4.py
- tests/quantization/test_compressed_tensors.py
- vllm/envs.py
- vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/model_executor/layers/quantization/utils/marlin_utils_fp4.py
- vllm/model_executor/layers/quantization/utils/nvfp4_emulation_utils.py
- vllm/model_executor/layers/quantization/utils/nvfp4_utils.py
- vllm/platforms/rocm.py
- vllm/utils/import_utils.py
head_ref_oid: 9a81cb9ad69287ccef8922bfb79d417e0ac15f16
artifact_dir: evidence/pull-bundles/vllm/gh-35733
---
# [NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on AMD Instinct MI300, MI355X and Hopper through emulation

- Repository: `vllm-project/vllm`
- PR: [35733](https://github.com/vllm-project/vllm/pull/35733)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `tests/models/quantization/test_nvfp4.py`
- `tests/quantization/test_compressed_tensors.py`
- `vllm/envs.py`
- `vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/model_executor/layers/quantization/utils/marlin_utils_fp4.py`
- `vllm/model_executor/layers/quantization/utils/nvfp4_emulation_utils.py`
- `vllm/model_executor/layers/quantization/utils/nvfp4_utils.py`
- `vllm/platforms/rocm.py`
- `vllm/utils/import_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-35733`
