Commits · 585e1223f0f39ee42f4df156f255abd128510f00 · change / sglang

18 Oct, 2025 1 commit
- [HiCache] feat: add more eviction policy (#11506) · 585e1223
  Teng Ma authored Oct 18, 2025
  
  585e1223
17 Oct, 2025 1 commit
- [Lint] Add `python/sglang` to ruff F401 checks and remove unused imports in files (#11685) · 62797440
  Chang Su authored Oct 17, 2025
  
  62797440
16 Oct, 2025 1 commit
- Revert "make radix cache deterministic" (#11728) · b0d1d717
  Baizhou Zhang authored Oct 16, 2025
  
  b0d1d717
15 Oct, 2025 1 commit
- Refactor kv cache free (#11351) · 1d7f7835
  cctry authored Oct 14, 2025
  
  1d7f7835
14 Oct, 2025 1 commit
- make radix cache deterministic (#10721) · dc965db0
  Alex Chi Z authored Oct 14, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
```
  dc965db0
10 Oct, 2025 1 commit

feat(hicache): Support passing prefix keys for l3 store. (#9045) · ee3bd8a1

hzh0425 authored Oct 10, 2025


Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

ee3bd8a1

07 Oct, 2025 1 commit
- EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
  Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  24bc3fb0
03 Oct, 2025 1 commit
- fix: radix cache memory accounting (#10637) · 1a31229c
  Alex Chi Z authored Oct 03, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
```
  1a31229c
30 Sep, 2025 1 commit
- Fix eagle radix cache (#10846) · 91847e38
  Ke Bao authored Sep 30, 2025
  
  91847e38
21 Sep, 2025 1 commit
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
18 Sep, 2025 1 commit

[HICache] introduce evict policy (#10190) · 1ccd59c7

Xuchun Shang authored Sep 18, 2025


Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>

1ccd59c7

09 Sep, 2025 1 commit
- [Refactor] Remove Hicache Load & Write threads (#10127) · 948b01a0
  DarkSharpness authored Sep 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  948b01a0
31 Aug, 2025 1 commit
- [HiCache] Storage Refactoring (#9797) · 8b6966d0
  Zhiqiang Xie authored Aug 31, 2025
```
Co-authored-by: pansicheng <27603155+pansicheng@users.noreply.github.com>
```
  8b6966d0
29 Aug, 2025 1 commit
- [HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776) · 54e872d3
  Zhiqiang Xie authored Aug 29, 2025
  
  54e872d3
26 Aug, 2025 1 commit
- HiCache Storage fix host memory leak (#9648) · 43de1d73
  Zhiqiang Xie authored Aug 26, 2025
  
  43de1d73
11 Aug, 2025 2 commits
- [fix] Set Radix tree root node hash to None - Nvidia Dynamo Integration (#9030) · ff1f6825
  Faradawn Yang authored Aug 11, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ff1f6825
- HiCache Storage: generate hash when inserting new nodes (#9053) · 9f78f391
  Zhiqiang Xie authored Aug 11, 2025
  
  9f78f391
18 Jul, 2025 1 commit
- Hicache Storage Layer Prototype (#7704) · 9d33fcfb
  Zhiqiang Xie authored Jul 18, 2025
  
  9d33fcfb
07 Jul, 2025 1 commit
- Kernels for efficient KV cache IO (#7313) · 2fc824b8
  Zhiqiang Xie authored Jul 06, 2025
  
  2fc824b8
22 Jun, 2025 1 commit
- [minor] simplify the `TokenToKVPoolAllocator` (#7414) · 05c9bc89
  Liangsheng Yin authored Jun 22, 2025
  
  05c9bc89
19 Jun, 2025 1 commit
- [Refactor] Clean up radix cache related API (#7303) · 47367b76
  DarkSharpness authored Jun 19, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  47367b76
11 Jun, 2025 1 commit
- [feat]: Emit fixed-size KV blocks events (#6824) · 777688b8
  Faradawn Yang authored Jun 11, 2025
  
  777688b8
19 May, 2025 1 commit
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
17 Mar, 2025 1 commit
- Fix: Complete int32 to int64 conversion (#4465) · f5bbf603
  Zhiqiang Xie authored Mar 16, 2025
  
  f5bbf603
16 Mar, 2025 1 commit
- [Fix] use `torch.cat` instead of `torch.concat` to prevent entering the... · 1a3fa75f
  JieXin Liang authored Mar 16, 2025
```
[Fix] use `torch.cat` instead of `torch.concat` to prevent entering the `Autograd` backends. (#4466)
```
  1a3fa75f
13 Mar, 2025 1 commit
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
06 Mar, 2025 1 commit
- Debug radixcache: refactor recursive helper methods (#3029) · 62b362b1
  luzengxiangcn authored Mar 06, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  62b362b1
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
27 Jan, 2025 1 commit
- Sanity check to prevent performance regression (#3171) · 08104b56
  Zhiqiang Xie authored Jan 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  08104b56
11 Dec, 2024 1 commit
- [Core] in batch prefix caching by delay scheduling (#2442) · 9208618b
  SangBin Cho authored Dec 11, 2024
  
  9208618b
20 Oct, 2024 1 commit
- Unify the memory pool api and tp worker API (#1724) · 59cbf476
  Lianmin Zheng authored Oct 19, 2024
  
  59cbf476
19 Oct, 2024 1 commit
- Fix the race condition in overlap mode (#1712) · 769bf11c
  Lianmin Zheng authored Oct 19, 2024
  
  769bf11c
17 Oct, 2024 1 commit
- feat: radix tree code optimize (#1697) · b1709305
  wxsm authored Oct 17, 2024
  
  b1709305
16 Oct, 2024 1 commit
- Add a new event loop (#1677) · 9116b289
  Lianmin Zheng authored Oct 16, 2024
  
  9116b289
24 Sep, 2024 1 commit
- debug radixcache stack_overflow (#1499) · e6692bf4
  luzengxiangcn authored Sep 24, 2024
  
  e6692bf4
12 Aug, 2024 1 commit
- Fix the prefix indices (#1037) · 7de60345
  Liangsheng Yin authored Aug 11, 2024
  
  7de60345
11 Aug, 2024 1 commit
- Improve type annotation (#1029) · 9dae4078
  Lianmin Zheng authored Aug 11, 2024
  
  9dae4078
10 Aug, 2024 1 commit
- Fix `input_ids` && rename to `fill_ids` (#1021) · 43fbb6d9
  Liangsheng Yin authored Aug 10, 2024
  
  43fbb6d9
09 Aug, 2024 1 commit
- Reduce the overhead when cache is disabled (#1010) · 62757db6
  Liangsheng Yin authored Aug 09, 2024
  
  62757db6