---
id: pr-sglang-23065
repo: sgl-project/sglang
pr: 23065
title: sglang miles lora
author: yushengsu-thu
date: '2026-04-21'
url: https://github.com/sgl-project/sglang/pull/23065
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 1ca33e4e95dda7d5afc9e461fa3924ea2f57e126
inclusion_reason: defer
changed_paths:
- benchmark/kernels/lora_csgmv/tune_lora_csgmv.py
- python/sglang/jit_kernel/csrc/moe/moe_align_kernel.cu
- python/sglang/jit_kernel/moe_align.py
- python/sglang/jit_kernel/tests/test_moe_align_block_size.py
- python/sglang/srt/layers/moe/fused_moe_triton/fused_moe_triton_kernels.py
- python/sglang/srt/layers/moe/moe_runner/base.py
- python/sglang/srt/layers/moe/moe_runner/deep_gemm.py
- python/sglang/srt/layers/moe/moe_runner/runner.py
- python/sglang/srt/layers/moe/moe_runner/triton.py
- python/sglang/srt/layers/moe/moe_runner/triton_kernels.py
- python/sglang/srt/layers/quantization/base_config.py
- python/sglang/srt/layers/quantization/blockwise_int8.py
- python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py
- python/sglang/srt/layers/quantization/compressed_tensors/schemes/compressed_tensors_wNa16_moe.py
- python/sglang/srt/layers/quantization/fp8.py
- python/sglang/srt/layers/quantization/moe_wna16.py
- python/sglang/srt/layers/quantization/unquant.py
- python/sglang/srt/layers/quantization/w8a8_fp8.py
- python/sglang/srt/layers/quantization/w8a8_int8.py
- python/sglang/srt/lora/backend/chunked_backend.py
- python/sglang/srt/lora/backend/torch_backend.py
- python/sglang/srt/lora/backend/triton_backend.py
- python/sglang/srt/lora/layers.py
- python/sglang/srt/lora/lora.py
- python/sglang/srt/lora/lora_manager.py
- python/sglang/srt/lora/lora_moe_runner_marlin.py
- python/sglang/srt/lora/lora_moe_runners.py
- python/sglang/srt/lora/mem_pool.py
- python/sglang/srt/lora/triton_ops/__init__.py
- python/sglang/srt/lora/triton_ops/chunked_sgmv_expand.py
- python/sglang/srt/lora/triton_ops/chunked_sgmv_shrink.py
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=1024,R=64,S=1,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=4096,R=64,S=3,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=6144,R=64,S=2,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=1024,R=64,S=2,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=1024,R=64,S=3,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=2048,R=64,S=1,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=3072,R=64,S=1,device=NVIDIA_H200.json
- python/sglang/srt/lora/triton_ops/gate_up_lora_b.py
- python/sglang/srt/lora/triton_ops/kernel_utils.py
- python/sglang/srt/lora/triton_ops/lora_tuning_config.py
- python/sglang/srt/lora/triton_ops/qkv_lora_b.py
- python/sglang/srt/lora/triton_ops/sgemm_lora_a.py
- python/sglang/srt/lora/triton_ops/sgemm_lora_b.py
- python/sglang/srt/lora/triton_ops/virtual_experts.py
- python/sglang/srt/lora/utils.py
- python/sglang/srt/server_args.py
- test/manual/lora/test_lora_tuning_config.py
- test/registered/lora/test_lora_deepseek_v3_base_logprob_diff.py
- test/registered/lora/test_lora_kimi_k25_logprob_diff.py
- test/registered/lora/test_lora_moe_runner.py
- test/registered/lora/test_marlin_lora_correctness.py
- test/registered/lora/test_sgemm_sorted_by_adapter.py
artifact_dir: evidence/pull-bundles/sglang/gh-23065
head_ref_oid: 672b8883e2b1c836cd4419c7dac8d92b18940ac4
---
# sglang miles lora

- Repository: `sgl-project/sglang`
- PR: [23065](https://github.com/sgl-project/sglang/pull/23065)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `benchmark/kernels/lora_csgmv/tune_lora_csgmv.py`
- `python/sglang/jit_kernel/csrc/moe/moe_align_kernel.cu`
- `python/sglang/jit_kernel/moe_align.py`
- `python/sglang/jit_kernel/tests/test_moe_align_block_size.py`
- `python/sglang/srt/layers/moe/fused_moe_triton/fused_moe_triton_kernels.py`
- `python/sglang/srt/layers/moe/moe_runner/base.py`
- `python/sglang/srt/layers/moe/moe_runner/deep_gemm.py`
- `python/sglang/srt/layers/moe/moe_runner/runner.py`
- `python/sglang/srt/layers/moe/moe_runner/triton.py`
- `python/sglang/srt/layers/moe/moe_runner/triton_kernels.py`
- `python/sglang/srt/layers/quantization/base_config.py`
- `python/sglang/srt/layers/quantization/blockwise_int8.py`
- `python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py`
- `python/sglang/srt/layers/quantization/compressed_tensors/schemes/compressed_tensors_wNa16_moe.py`
- `python/sglang/srt/layers/quantization/fp8.py`
- `python/sglang/srt/layers/quantization/moe_wna16.py`
- `python/sglang/srt/layers/quantization/unquant.py`
- `python/sglang/srt/layers/quantization/w8a8_fp8.py`
- `python/sglang/srt/layers/quantization/w8a8_int8.py`
- `python/sglang/srt/lora/backend/chunked_backend.py`
- `python/sglang/srt/lora/backend/torch_backend.py`
- `python/sglang/srt/lora/backend/triton_backend.py`
- `python/sglang/srt/lora/layers.py`
- `python/sglang/srt/lora/lora.py`
- `python/sglang/srt/lora/lora_manager.py`
- `python/sglang/srt/lora/lora_moe_runner_marlin.py`
- `python/sglang/srt/lora/lora_moe_runners.py`
- `python/sglang/srt/lora/mem_pool.py`
- `python/sglang/srt/lora/triton_ops/__init__.py`
- `python/sglang/srt/lora/triton_ops/chunked_sgmv_expand.py`
- `python/sglang/srt/lora/triton_ops/chunked_sgmv_shrink.py`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=1024,R=64,S=1,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=4096,R=64,S=3,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_expand,K=6144,R=64,S=2,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=1024,R=64,S=2,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=1024,R=64,S=3,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=2048,R=64,S=1,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/csgmv_configs/triton_3_5_1/lora_shrink,K=3072,R=64,S=1,device=NVIDIA_H200.json`
- `python/sglang/srt/lora/triton_ops/gate_up_lora_b.py`
- `python/sglang/srt/lora/triton_ops/kernel_utils.py`
- `python/sglang/srt/lora/triton_ops/lora_tuning_config.py`
- `python/sglang/srt/lora/triton_ops/qkv_lora_b.py`
- `python/sglang/srt/lora/triton_ops/sgemm_lora_a.py`
- `python/sglang/srt/lora/triton_ops/sgemm_lora_b.py`
- `python/sglang/srt/lora/triton_ops/virtual_experts.py`
- `python/sglang/srt/lora/utils.py`
- `python/sglang/srt/server_args.py`
- `test/manual/lora/test_lora_tuning_config.py`
- `test/registered/lora/test_lora_deepseek_v3_base_logprob_diff.py`
- `test/registered/lora/test_lora_kimi_k25_logprob_diff.py`
- `test/registered/lora/test_lora_moe_runner.py`
- `test/registered/lora/test_marlin_lora_correctness.py`
- `test/registered/lora/test_sgemm_sorted_by_adapter.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-23065`
