---
id: pr-sglang-2693
repo: sgl-project/sglang
pr: 2693
title: Hierarchical Caching for SGLang
author: xiezhq-hermann
date: '2025-02-24'
url: https://github.com/sgl-project/sglang/pull/2693
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 6c7a152c5aa1ec87b5a402014fce0234ddb0efce
inclusion_reason: include
changed_paths:
- benchmark/hicache/README.md
- benchmark/hicache/bench_multiturn.py
- python/sglang/srt/managers/cache_controller.py
- python/sglang/srt/managers/scheduler.py
- python/sglang/srt/mem_cache/hiradix_cache.py
- python/sglang/srt/mem_cache/memory_pool.py
- python/sglang/srt/utils.py
artifact_dir: evidence/pull-bundles/sglang/gh-2693
head_ref_oid: a37244a9aae5eebe4a3fdadf060809e332ded32c
---
# Hierarchical Caching for SGLang

- Repository: `sgl-project/sglang`
- PR: [2693](https://github.com/sgl-project/sglang/pull/2693)
- Decision: `include`
- Reason: include

## Changed Paths

- `benchmark/hicache/README.md`
- `benchmark/hicache/bench_multiturn.py`
- `python/sglang/srt/managers/cache_controller.py`
- `python/sglang/srt/managers/scheduler.py`
- `python/sglang/srt/mem_cache/hiradix_cache.py`
- `python/sglang/srt/mem_cache/memory_pool.py`
- `python/sglang/srt/utils.py`

## Evidence Bundle

`evidence/pull-bundles/sglang/gh-2693`
