---
id: pr-sglang-10062
repo: sgl-project/sglang
pr: 10062
title: Piecewise CUDA Graph Support & Torch Compile Backend
author: Oasis-Git
date: '2025-10-12'
url: https://github.com/sgl-project/sglang/pull/10062
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 4ac8e09df0a908c05db4b952ce1b19d705dc92b8
inclusion_reason: defer
changed_paths:
- python/sglang/srt/distributed/device_communicators/custom_all_reduce.py
- python/sglang/srt/distributed/parallel_state.py
- python/sglang/srt/layers/layernorm.py
- python/sglang/srt/layers/radix_attention.py
- python/sglang/srt/model_executor/compilation/backend.py
- python/sglang/srt/model_executor/compilation/compilation_config.py
- python/sglang/srt/model_executor/compilation/compilation_counter.py
- python/sglang/srt/model_executor/compilation/compile.py
- python/sglang/srt/model_executor/compilation/compiler_interface.py
- python/sglang/srt/model_executor/compilation/cuda_piecewise_backend.py
- python/sglang/srt/model_executor/compilation/fix_functionalization.py
- python/sglang/srt/model_executor/compilation/fx_utils.py
- python/sglang/srt/model_executor/compilation/inductor_pass.py
- python/sglang/srt/model_executor/compilation/pass_manager.py
- python/sglang/srt/model_executor/compilation/piecewise_context_manager.py
- python/sglang/srt/model_executor/compilation/weak_ref_tensor.cpp
- python/sglang/srt/model_executor/compilation/weak_ref_tensor_jit.py
- python/sglang/srt/model_executor/model_runner.py
- python/sglang/srt/model_executor/piecewise_cuda_graph_runner.py
- python/sglang/srt/server_args.py
- test/srt/test_piecewise_cuda_graph.py
artifact_dir: evidence/pull-bundles/sglang/gh-10062
head_ref_oid: b23a7fff3cb29b86c4a28c4f557d0782666f32c5
---
# Piecewise CUDA Graph Support & Torch Compile Backend

- Repository: `sgl-project/sglang`
- PR: [10062](https://github.com/sgl-project/sglang/pull/10062)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `python/sglang/srt/distributed/device_communicators/custom_all_reduce.py`
- `python/sglang/srt/distributed/parallel_state.py`
- `python/sglang/srt/layers/layernorm.py`
- `python/sglang/srt/layers/radix_attention.py`
- `python/sglang/srt/model_executor/compilation/backend.py`
- `python/sglang/srt/model_executor/compilation/compilation_config.py`
- `python/sglang/srt/model_executor/compilation/compilation_counter.py`
- `python/sglang/srt/model_executor/compilation/compile.py`
- `python/sglang/srt/model_executor/compilation/compiler_interface.py`
- `python/sglang/srt/model_executor/compilation/cuda_piecewise_backend.py`
- `python/sglang/srt/model_executor/compilation/fix_functionalization.py`
- `python/sglang/srt/model_executor/compilation/fx_utils.py`
- `python/sglang/srt/model_executor/compilation/inductor_pass.py`
- `python/sglang/srt/model_executor/compilation/pass_manager.py`
- `python/sglang/srt/model_executor/compilation/piecewise_context_manager.py`
- `python/sglang/srt/model_executor/compilation/weak_ref_tensor.cpp`
- `python/sglang/srt/model_executor/compilation/weak_ref_tensor_jit.py`
- `python/sglang/srt/model_executor/model_runner.py`
- `python/sglang/srt/model_executor/piecewise_cuda_graph_runner.py`
- `python/sglang/srt/server_args.py`
- `test/srt/test_piecewise_cuda_graph.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-10062`
