---
id: pr-sglang-20910
repo: sgl-project/sglang
pr: 20910
title: Add SGLang CUDA crash API logging inspired by FlashInfer
author: BBuf
date: '2026-03-22'
url: https://github.com/sgl-project/sglang/pull/20910
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- flash-attention
- fp4
- fp8
- kernel-fusion
- moe
- nvfp4
- quantization
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- attention
- flash-attention
- moe
- quantization
languages:
- cuda-cpp
- python
- triton
captured_at: '2026-04-17'
status: merged
merge_sha: 766d225fccf01bdd41a35dc95300952b511454de
inclusion_reason: kernel file changes
changed_paths:
- .claude/skills/debug-cuda-crash/SKILL.md
- docs/diffusion/environment_variables.md
- docs/references/environment_variables.md
- python/sglang/jit_kernel/awq_marlin_repack.py
- python/sglang/jit_kernel/debug_utils.py
- python/sglang/jit_kernel/diffusion/triton/norm.py
- python/sglang/jit_kernel/diffusion/triton/rmsnorm_onepass.py
- python/sglang/jit_kernel/diffusion/triton/rotary.py
- python/sglang/jit_kernel/diffusion/triton/scale_shift.py
- python/sglang/jit_kernel/flash_attention_v4.py
- python/sglang/jit_kernel/fused_store_index_cache.py
- python/sglang/jit_kernel/gptq_marlin.py
- python/sglang/jit_kernel/gptq_marlin_repack.py
- python/sglang/jit_kernel/hicache.py
- python/sglang/jit_kernel/moe_wna16_marlin.py
- python/sglang/jit_kernel/ngram_embedding.py
- python/sglang/jit_kernel/norm.py
- python/sglang/jit_kernel/nvfp4.py
- python/sglang/jit_kernel/per_tensor_quant_fp8.py
- python/sglang/jit_kernel/per_token_group_quant_8bit.py
- python/sglang/jit_kernel/rope.py
- python/sglang/jit_kernel/timestep_embedding.py
- python/sglang/kernel_api_logging.py
- python/sglang/multimodal_gen/runtime/layers/attention/backends/attention_backend.py
- python/sglang/multimodal_gen/runtime/layers/attention/layer.py
- python/sglang/multimodal_gen/runtime/layers/custom_op.py
- python/sglang/multimodal_gen/runtime/layers/linear.py
- python/sglang/multimodal_gen/runtime/layers/rotary_embedding/utils.py
- python/sglang/multimodal_gen/runtime/layers/utils.py
- python/sglang/multimodal_gen/runtime/models/dits/hunyuan3d.py
- python/sglang/srt/layers/attention/base_attn_backend.py
- python/sglang/srt/layers/attention/flashinfer_backend.py
- python/sglang/srt/layers/linear.py
- python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py
- python/sglang/srt/layers/moe/token_dispatcher/flashinfer.py
- python/sglang/srt/layers/quantization/bitsandbytes.py
- python/sglang/srt/layers/quantization/fp8.py
- python/sglang/srt/layers/utils/multi_platform.py
- python/sglang/srt/mem_cache/memory_pool.py
- python/sglang/srt/models/deepseek_common/utils.py
- python/sglang/srt/models/kimi_vl_moonvit.py
- python/sglang/srt/models/minimax_m2.py
- python/sglang/srt/utils/custom_op.py
- sgl-kernel/python/sgl_kernel/__init__.py
- sgl-kernel/python/sgl_kernel/debug_utils.py
- sgl-kernel/python/sgl_kernel/flash_attn.py
artifact_dir: evidence/pull-bundles/sglang/gh-20910
head_ref_oid: 1ebcb1e7035d3911ae0ffd899e816ff1e9b29a9f
---
# Add SGLang CUDA crash API logging inspired by FlashInfer

- Repository: `sgl-project/sglang`
- PR: [20910](https://github.com/sgl-project/sglang/pull/20910)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `.claude/skills/debug-cuda-crash/SKILL.md`
- `docs/diffusion/environment_variables.md`
- `docs/references/environment_variables.md`
- `python/sglang/jit_kernel/awq_marlin_repack.py`
- `python/sglang/jit_kernel/debug_utils.py`
- `python/sglang/jit_kernel/diffusion/triton/norm.py`
- `python/sglang/jit_kernel/diffusion/triton/rmsnorm_onepass.py`
- `python/sglang/jit_kernel/diffusion/triton/rotary.py`
- `python/sglang/jit_kernel/diffusion/triton/scale_shift.py`
- `python/sglang/jit_kernel/flash_attention_v4.py`
- `python/sglang/jit_kernel/fused_store_index_cache.py`
- `python/sglang/jit_kernel/gptq_marlin.py`
- `python/sglang/jit_kernel/gptq_marlin_repack.py`
- `python/sglang/jit_kernel/hicache.py`
- `python/sglang/jit_kernel/moe_wna16_marlin.py`
- `python/sglang/jit_kernel/ngram_embedding.py`
- `python/sglang/jit_kernel/norm.py`
- `python/sglang/jit_kernel/nvfp4.py`
- `python/sglang/jit_kernel/per_tensor_quant_fp8.py`
- `python/sglang/jit_kernel/per_token_group_quant_8bit.py`
- `python/sglang/jit_kernel/rope.py`
- `python/sglang/jit_kernel/timestep_embedding.py`
- `python/sglang/kernel_api_logging.py`
- `python/sglang/multimodal_gen/runtime/layers/attention/backends/attention_backend.py`
- `python/sglang/multimodal_gen/runtime/layers/attention/layer.py`
- `python/sglang/multimodal_gen/runtime/layers/custom_op.py`
- `python/sglang/multimodal_gen/runtime/layers/linear.py`
- `python/sglang/multimodal_gen/runtime/layers/rotary_embedding/utils.py`
- `python/sglang/multimodal_gen/runtime/layers/utils.py`
- `python/sglang/multimodal_gen/runtime/models/dits/hunyuan3d.py`
- `python/sglang/srt/layers/attention/base_attn_backend.py`
- `python/sglang/srt/layers/attention/flashinfer_backend.py`
- `python/sglang/srt/layers/linear.py`
- `python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py`
- `python/sglang/srt/layers/moe/token_dispatcher/flashinfer.py`
- `python/sglang/srt/layers/quantization/bitsandbytes.py`
- `python/sglang/srt/layers/quantization/fp8.py`
- `python/sglang/srt/layers/utils/multi_platform.py`
- `python/sglang/srt/mem_cache/memory_pool.py`
- `python/sglang/srt/models/deepseek_common/utils.py`
- `python/sglang/srt/models/kimi_vl_moonvit.py`
- `python/sglang/srt/models/minimax_m2.py`
- `python/sglang/srt/utils/custom_op.py`
- `sgl-kernel/python/sgl_kernel/__init__.py`
- `sgl-kernel/python/sgl_kernel/debug_utils.py`
- `sgl-kernel/python/sgl_kernel/flash_attn.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-20910`
