---
id: pr-sglang-14423
repo: sgl-project/sglang
pr: 14423
title: '[NPU] perf update with kvcache nz & w4a8 quant'
author: liupeng374
date: '2025-12-13'
url: https://github.com/sgl-project/sglang/pull/14423
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- kernel-fusion
- mla
- moe
- quantization
techniques:
- kernel-fusion
hardware_features: []
kernel_types:
- attention
- mla
- moe
- quantization
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: d36299ad774fe139b2b9afc85a97d9115e6a3067
inclusion_reason: kernel file changes
changed_paths:
- python/sglang/srt/hardware_backend/npu/attention/ascend_backend.py
- python/sglang/srt/hardware_backend/npu/attention/mla_preprocess.py
- python/sglang/srt/hardware_backend/npu/modules/deepseek_v2_attention_mla_npu.py
- python/sglang/srt/hardware_backend/npu/quantization/fused_moe_method_npu.py
- python/sglang/srt/layers/rotary_embedding.py
- python/sglang/srt/model_executor/forward_batch_info.py
head_ref_oid: 5e2ef78c0289e6628b10e358116d98589726c4e6
artifact_dir: evidence/pull-bundles/sglang/gh-14423
---
# [NPU] perf update with kvcache nz & w4a8 quant

- Repository: `sgl-project/sglang`
- PR: [14423](https://github.com/sgl-project/sglang/pull/14423)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `python/sglang/srt/hardware_backend/npu/attention/ascend_backend.py`
- `python/sglang/srt/hardware_backend/npu/attention/mla_preprocess.py`
- `python/sglang/srt/hardware_backend/npu/modules/deepseek_v2_attention_mla_npu.py`
- `python/sglang/srt/hardware_backend/npu/quantization/fused_moe_method_npu.py`
- `python/sglang/srt/layers/rotary_embedding.py`
- `python/sglang/srt/model_executor/forward_batch_info.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-14423`
