---
id: pr-sglang-23787
repo: sgl-project/sglang
pr: 23787
title: amd/deepseek_v4 integration 1/N - 0426
author: HaiShaw
date: '2026-04-27'
url: https://github.com/sgl-project/sglang/pull/23787
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: d773133086dc4a7f04a5cb0a7a7e4004369f5bfd
inclusion_reason: defer
changed_paths:
- .codespellrc
- .github/workflows/release-pypi-nightly.yml
- .github/workflows/release-whl-kernel.yml
- docker/Dockerfile
- docs_new/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx
- docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx
- python/pyproject.toml
- python/run_dsv4.sh
- python/sglang/jit_kernel/activation.py
- python/sglang/jit_kernel/benchmark/bench_activation.py
- python/sglang/jit_kernel/csrc/deepseek_v4/c128.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/c4.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/common.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/fused_norm_rope.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/hash_topk.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/hisparse_transfer.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/paged_mqa_metadata.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/rope.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/silu_and_mul_masked_post_quant.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/store.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/topk.cuh
- python/sglang/jit_kernel/csrc/deepseek_v4/topk_v2.cuh
- python/sglang/jit_kernel/csrc/elementwise/activation.cuh
- python/sglang/jit_kernel/deepseek_v4.py
- python/sglang/jit_kernel/tests/test_activation.py
- python/sglang/multimodal_gen/runtime/disaggregation/scheduler_mixin.py
- python/sglang/multimodal_gen/runtime/pipelines_core/diffusion_scheduler_utils.py
- python/sglang/multimodal_gen/runtime/pipelines_core/schedule_batch.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/causal_denoising.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising_av.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising_dmd.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/hunyuan3d_paint.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/hunyuan3d_shape.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/ltx_2_denoising.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/glm_image.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/helios_denoising.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/mova.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/qwen_image_layered.py
- python/sglang/multimodal_gen/runtime/pipelines_core/stages/timestep_preparation.py
- python/sglang/srt/configs/deepseek_v4.py
- python/sglang/srt/configs/model_config.py
- python/sglang/srt/debug_utils/deepseek_v4_debug_utils.py
- python/sglang/srt/entrypoints/engine.py
- python/sglang/srt/entrypoints/openai/encoding_dsv4.py
- python/sglang/srt/entrypoints/openai/serving_chat.py
- python/sglang/srt/environ.py
- python/sglang/srt/flashmla_tests/__init__.py
- python/sglang/srt/flashmla_tests/kernelkit/.gitignore
- python/sglang/srt/flashmla_tests/kernelkit/__init__.py
- python/sglang/srt/flashmla_tests/kernelkit/bench.py
- python/sglang/srt/flashmla_tests/kernelkit/compare.py
- python/sglang/srt/flashmla_tests/kernelkit/generate.py
- python/sglang/srt/flashmla_tests/kernelkit/precision.py
- python/sglang/srt/flashmla_tests/kernelkit/utils.py
- python/sglang/srt/flashmla_tests/lib.py
- python/sglang/srt/flashmla_tests/quant.py
- python/sglang/srt/flashmla_tests/ref.py
- python/sglang/srt/function_call/deepseekv4_detector.py
- python/sglang/srt/function_call/function_call_parser.py
- python/sglang/srt/layers/attention/attention_registry.py
- python/sglang/srt/layers/attention/compressed/__init__.py
- python/sglang/srt/layers/attention/compressed/compressor.py
- python/sglang/srt/layers/attention/compressed/indexer.py
- python/sglang/srt/layers/attention/compressed/metadata.py
- python/sglang/srt/layers/attention/compressed/paged_prefill.py
- python/sglang/srt/layers/attention/debug_flash_mla_adapter.py
- python/sglang/srt/layers/attention/deepseek_v4_backend.py
- python/sglang/srt/layers/attention/deepseek_v4_backend_radix.py
- python/sglang/srt/layers/attention/indexer_topk_capturer.py
- python/sglang/srt/layers/attention/nsa/index_buf_accessor.py
- python/sglang/srt/layers/attention/nsa/index_buf_accessor_v4.py
- python/sglang/srt/layers/attention/nsa/nsa_indexer.py
- python/sglang/srt/layers/attention/nsa/quant_k_cache_v4.py
- python/sglang/srt/layers/attention/nsa/utils.py
- python/sglang/srt/layers/attention/triton_ops/compressed_metadata.py
- python/sglang/srt/layers/deep_gemm_wrapper/paged_mqa_logits.py
- python/sglang/srt/layers/deepseek_v4_rope.py
- python/sglang/srt/layers/mhc.py
- python/sglang/srt/layers/moe/deepseek_v4_topk.py
- python/sglang/srt/layers/moe/moe_runner/triton_utils/fused_moe.py
- python/sglang/srt/layers/moe/moe_runner/triton_utils/fused_moe_triton_kernels.py
- python/sglang/srt/layers/topk_capturer_base.py
- python/sglang/srt/managers/hisparse_coordinator.py
- python/sglang/srt/managers/scheduler.py
- python/sglang/srt/managers/scheduler_runtime_checker_mixin.py
- python/sglang/srt/mem_cache/compress_state.py
- python/sglang/srt/mem_cache/deepseekv4_memory_pool.py
- python/sglang/srt/model_executor/forward_batch_info.py
- python/sglang/srt/model_executor/memory_profiler.py
- python/sglang/srt/model_executor/model_runner_kv_cache_mixin.py
- python/sglang/srt/model_executor/pool_configurator.py
- python/sglang/srt/model_loader/utils.py
- python/sglang/srt/models/bailing_moe.py
- python/sglang/srt/models/bailing_moe_linear.py
- python/sglang/srt/models/deepseek_v2.py
- python/sglang/srt/models/deepseek_v4.py
- python/sglang/srt/models/deepseek_v4_nextn.py
- python/sglang/srt/models/exaone_moe.py
- python/sglang/srt/models/glm4_moe.py
- python/sglang/srt/models/hunyuan_v3.py
- python/sglang/srt/models/llada2.py
- python/sglang/srt/models/llama4.py
- python/sglang/srt/models/mimo_v2_flash.py
- python/sglang/srt/models/minimax_m2.py
- python/sglang/srt/models/qwen3_moe.py
- python/sglang/srt/models/sarvam_moe.py
- python/sglang/srt/models/sdar_moe.py
- python/sglang/srt/models/step3p5.py
- python/sglang/srt/parser/reasoning_parser.py
- python/sglang/srt/server_args.py
- python/sglang/srt/utils/common.py
- python/sglang/srt/utils/hf_transformers/common.py
- python/sglang/srt/utils/hf_transformers/config.py
- sgl-kernel/pyproject.toml
- sgl-kernel/pyproject_cpu.toml
- sgl-kernel/pyproject_musa.toml
- sgl-kernel/pyproject_rocm.toml
- sgl-kernel/python/sgl_kernel/version.py
- sglang-format.sh
artifact_dir: evidence/pull-bundles/sglang/gh-23787
head_ref_oid: 5ae08b71b80f71c3392e969ed71afdada991e09e
---
# amd/deepseek_v4 integration 1/N - 0426

- Repository: `sgl-project/sglang`
- PR: [23787](https://github.com/sgl-project/sglang/pull/23787)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `.codespellrc`
- `.github/workflows/release-pypi-nightly.yml`
- `.github/workflows/release-whl-kernel.yml`
- `docker/Dockerfile`
- `docs_new/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx`
- `docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx`
- `python/pyproject.toml`
- `python/run_dsv4.sh`
- `python/sglang/jit_kernel/activation.py`
- `python/sglang/jit_kernel/benchmark/bench_activation.py`
- `python/sglang/jit_kernel/csrc/deepseek_v4/c128.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/c4.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/common.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/fused_norm_rope.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/hash_topk.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/hisparse_transfer.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/paged_mqa_metadata.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/rope.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/silu_and_mul_masked_post_quant.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/store.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/topk.cuh`
- `python/sglang/jit_kernel/csrc/deepseek_v4/topk_v2.cuh`
- `python/sglang/jit_kernel/csrc/elementwise/activation.cuh`
- `python/sglang/jit_kernel/deepseek_v4.py`
- `python/sglang/jit_kernel/tests/test_activation.py`
- `python/sglang/multimodal_gen/runtime/disaggregation/scheduler_mixin.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/diffusion_scheduler_utils.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/schedule_batch.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/causal_denoising.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising_av.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/denoising_dmd.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/hunyuan3d_paint.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/hunyuan3d_shape.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/ltx_2_denoising.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/glm_image.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/helios_denoising.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/mova.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/model_specific_stages/qwen_image_layered.py`
- `python/sglang/multimodal_gen/runtime/pipelines_core/stages/timestep_preparation.py`
- `python/sglang/srt/configs/deepseek_v4.py`
- `python/sglang/srt/configs/model_config.py`
- `python/sglang/srt/debug_utils/deepseek_v4_debug_utils.py`
- `python/sglang/srt/entrypoints/engine.py`
- `python/sglang/srt/entrypoints/openai/encoding_dsv4.py`
- `python/sglang/srt/entrypoints/openai/serving_chat.py`
- `python/sglang/srt/environ.py`
- `python/sglang/srt/flashmla_tests/__init__.py`
- `python/sglang/srt/flashmla_tests/kernelkit/.gitignore`
- `python/sglang/srt/flashmla_tests/kernelkit/__init__.py`
- `python/sglang/srt/flashmla_tests/kernelkit/bench.py`
- `python/sglang/srt/flashmla_tests/kernelkit/compare.py`
- `python/sglang/srt/flashmla_tests/kernelkit/generate.py`
- `python/sglang/srt/flashmla_tests/kernelkit/precision.py`
- `python/sglang/srt/flashmla_tests/kernelkit/utils.py`
- `python/sglang/srt/flashmla_tests/lib.py`
- `python/sglang/srt/flashmla_tests/quant.py`
- `python/sglang/srt/flashmla_tests/ref.py`
- `python/sglang/srt/function_call/deepseekv4_detector.py`
- `python/sglang/srt/function_call/function_call_parser.py`
- `python/sglang/srt/layers/attention/attention_registry.py`
- `python/sglang/srt/layers/attention/compressed/__init__.py`
- `python/sglang/srt/layers/attention/compressed/compressor.py`
- `python/sglang/srt/layers/attention/compressed/indexer.py`
- `python/sglang/srt/layers/attention/compressed/metadata.py`
- `python/sglang/srt/layers/attention/compressed/paged_prefill.py`
- `python/sglang/srt/layers/attention/debug_flash_mla_adapter.py`
- `python/sglang/srt/layers/attention/deepseek_v4_backend.py`
- `python/sglang/srt/layers/attention/deepseek_v4_backend_radix.py`
- `python/sglang/srt/layers/attention/indexer_topk_capturer.py`
- `python/sglang/srt/layers/attention/nsa/index_buf_accessor.py`
- `python/sglang/srt/layers/attention/nsa/index_buf_accessor_v4.py`
- `python/sglang/srt/layers/attention/nsa/nsa_indexer.py`
- `python/sglang/srt/layers/attention/nsa/quant_k_cache_v4.py`
- `python/sglang/srt/layers/attention/nsa/utils.py`
- `python/sglang/srt/layers/attention/triton_ops/compressed_metadata.py`
- `python/sglang/srt/layers/deep_gemm_wrapper/paged_mqa_logits.py`
- `python/sglang/srt/layers/deepseek_v4_rope.py`
- `python/sglang/srt/layers/mhc.py`
- `python/sglang/srt/layers/moe/deepseek_v4_topk.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-23787`
