Commits · 70cf4abccc03d69d35894ab8bec3e75bef48f00f · zhaoyu6 / sglang

22 Aug, 2025 1 commit
- 3fs zerocopy (#9109) · 70cf4abc
  pansicheng authored Aug 22, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  70cf4abc
14 Aug, 2025 1 commit
- fix io group (#9154) · 733446dd
  pansicheng authored Aug 14, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  733446dd
12 Aug, 2025 1 commit
- Support page first layout zero copy for mooncake store (#8651) · 0edda320
  huangtingwei authored Aug 13, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  0edda320
11 Aug, 2025 1 commit
- HiCache Storage: generate hash when inserting new nodes (#9053) · 9f78f391
  Zhiqiang Xie authored Aug 11, 2025
  
  9f78f391
10 Aug, 2025 1 commit
- [hicache] Optimization for DMA copy (#8245) · 5c31b35d
  cctry authored Aug 09, 2025
  
  5c31b35d
09 Aug, 2025 1 commit
- HiCache Storage tp fix (#8878) · 6e0b6468
  Zhiqiang Xie authored Aug 09, 2025
  
  6e0b6468
08 Aug, 2025 1 commit
- Simple prefetch policy (#8692) · e2fd2b9c
  pansicheng authored Aug 08, 2025
  
  e2fd2b9c
04 Aug, 2025 1 commit
- [bugfix] fix import path in HiCacheController (#8749) · 36fc9260
  Baron Liu authored Aug 04, 2025
  
  36fc9260
01 Aug, 2025 2 commits
- bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668) · d1c4d51c
  hzh0425 authored Aug 02, 2025
  
  d1c4d51c
- Interface change for kvcache io to support page first layout (#8318) · dd7ca006
  Zhiqiang Xie authored Jul 31, 2025
  
  dd7ca006
31 Jul, 2025 4 commits

Conditionally import HiCacheHF3FS (#8598) · 3dde8619
pansicheng authored Aug 01, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
3dde8619

SGLang HiCache NIXL Connector (#8488) · 2cd2e27f

Vishwanath Venkatesan authored Jul 31, 2025


Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com>
Co-authored-by: Moein Khazraee <moein@nvidia.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

2cd2e27f

Support l3 cache (mooncake store) for hiradix cache (#7211) · d9049592

huangtingwei authored Jul 31, 2025


Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>

d9049592

Add hf3fs support for hicache storage (based on #7704) (#7280) · 29980334
pansicheng authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
29980334

27 Jul, 2025 1 commit
- HiCache, check before terminate prefetching (#8372) · 528bd1ed
  Zhiqiang Xie authored Jul 26, 2025
  
  528bd1ed
25 Jul, 2025 1 commit
- HiCache Storage TP Refinement (#8307) · 145482f4
  Zhiqiang Xie authored Jul 24, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  145482f4
23 Jul, 2025 1 commit
- HiCache Fix (#8288) · f39037ff
  Zhiqiang Xie authored Jul 23, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  f39037ff
18 Jul, 2025 1 commit
- Hicache Storage Layer Prototype (#7704) · 9d33fcfb
  Zhiqiang Xie authored Jul 18, 2025
  
  9d33fcfb
07 Jul, 2025 1 commit
- Kernels for efficient KV cache IO (#7313) · 2fc824b8
  Zhiqiang Xie authored Jul 06, 2025
  
  2fc824b8
22 Jun, 2025 1 commit
- [minor] simplify the `TokenToKVPoolAllocator` (#7414) · 05c9bc89
  Liangsheng Yin authored Jun 22, 2025
  
  05c9bc89
18 Jun, 2025 1 commit
- Upstreaming hicache bug fixes (#7267) · e56685ac
  Zhiqiang Xie authored Jun 17, 2025
  
  e56685ac
15 Jun, 2025 1 commit
- Move host memory pools into a separate file (#7200) · a023856b
  Lianmin Zheng authored Jun 14, 2025
  
  a023856b
09 May, 2025 1 commit
- fix bug that gpu0 occupies more memory when hicache is turned on (#5778) · d2cb3024
  huangtingwei authored May 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  d2cb3024
02 Apr, 2025 1 commit
- Large page size aligned hierarchical caching (#4581) · e119f042
  Zhiqiang Xie authored Apr 01, 2025
  
  e119f042
14 Mar, 2025 1 commit

Hierarchical Caching supports MLA (#4009) · 0e0ec702

Lu Changqi authored Mar 14, 2025


Signed-off-by: Changqi Lu <luchangqi.123@bytedance.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0e0ec702

13 Mar, 2025 1 commit
- Hot fix for hicache with new page aligned radixtree (#4397) · fbdb5050
  Zhiqiang Xie authored Mar 13, 2025
  
  fbdb5050
12 Mar, 2025 1 commit
- Hierarchical Caching Refactoring and Fixing TP issue (#4082) · 10b544ae
  Zhiqiang Xie authored Mar 12, 2025
  
  10b544ae
07 Mar, 2025 1 commit
- Memory pool fix for upstream change about eagle (#4170) · 9376ac36
  Zhiqiang Xie authored Mar 07, 2025
  
  9376ac36
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
24 Feb, 2025 1 commit

Hierarchical Caching for SGLang (#2693) · 6c7a152c

Zhiqiang Xie authored Feb 23, 2025


Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

6c7a152c

11 Jan, 2025 1 commit
- Cache controller for hierarchical caching (#2804) · 5d6e9467
  Zhiqiang Xie authored Jan 10, 2025
  
  5d6e9467