---
id: pr-vllm-38083
repo: vllm-project/vllm
pr: 38083
title: '[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell'
author: vadiklyutiy
date: '2026-03-26'
url: https://github.com/vllm-project/vllm/pull/38083
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- fp8
- gemm
- nvfp4
- quantization
techniques: []
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- gemm
- quantization
languages:
- python
captured_at: '2026-04-17'
status: merged
merge_sha: 52069012fe53714581682ded6746cd311108bf3a
inclusion_reason: kernel file changes
changed_paths:
- tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-DEP2.yaml
- tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-FP8-DEP2.yaml
- tests/evals/gsm8k/configs/Qwen3.5-397B-A17B-NVFP4-DEP2.yaml
- tests/evals/gsm8k/configs/models-qwen35-blackwell.txt
- tests/evals/gsm8k/test_gsm8k_correctness.py
- vllm/config/vllm.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/input_quant_fp8.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/utils/deep_gemm.py
head_ref_oid: 721d96d644a2ec79263a86829220d13471becdd2
artifact_dir: evidence/pull-bundles/vllm/gh-38083
---
# [Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell

- Repository: `vllm-project/vllm`
- PR: [38083](https://github.com/vllm-project/vllm/pull/38083)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-DEP2.yaml`
- `tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-FP8-DEP2.yaml`
- `tests/evals/gsm8k/configs/Qwen3.5-397B-A17B-NVFP4-DEP2.yaml`
- `tests/evals/gsm8k/configs/models-qwen35-blackwell.txt`
- `tests/evals/gsm8k/test_gsm8k_correctness.py`
- `vllm/config/vllm.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/input_quant_fp8.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/utils/deep_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-38083`
