Commits · a40229f6f8285e814d9ba8f3469eb99968c85b2e · change / sglang · GitLab

15 Oct, 2025 2 commits
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
- [router] update router doc to latest features (#11639) · e0c2af2a
  Simo Lin authored Oct 14, 2025
  
  e0c2af2a
14 Oct, 2025 3 commits
- [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) · 642fa966
  Wenyi Xu authored Oct 14, 2025
  
  642fa966
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
13 Oct, 2025 2 commits
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- docs(router): add token-bucket rate limiting to the docs (#11485) · 8e776c78
  Jonah Bernard authored Oct 12, 2025
  
  8e776c78
12 Oct, 2025 1 commit
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
11 Oct, 2025 1 commit
- [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) · f5754d12
  ykcombat authored Oct 11, 2025
  
  f5754d12
08 Oct, 2025 2 commits
- [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) · 0a7c4bde
  Shangming Cai authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  0a7c4bde
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
07 Oct, 2025 4 commits
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
06 Oct, 2025 1 commit
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
03 Oct, 2025 1 commit
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
02 Oct, 2025 1 commit
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 1 commit
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
25 Sep, 2025 1 commit

Rename customer label -> custom label (#10899) · f68dd998

Lianmin Zheng authored Sep 25, 2025


Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f68dd998

24 Sep, 2025 1 commit

chore: Initial support for input config files (#10534) · d7b20dd6

kushanam authored Sep 24, 2025


Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

d7b20dd6

21 Sep, 2025 1 commit
- [3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592) · 08ecd0aa
  Lifu Huang authored Sep 20, 2025
  
  08ecd0aa
16 Sep, 2025 1 commit
- Fix formatting in long code blocks (#10528) · 7f028b07
  Philip Kiely - Baseten authored Sep 16, 2025
  
  7f028b07
15 Sep, 2025 1 commit
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
09 Sep, 2025 1 commit
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
08 Sep, 2025 2 commits
- Revert "enable auto-round quantization model (#6226)" (#10148) · b7d1f17b
  Yineng Zhang authored Sep 07, 2025
  
  b7d1f17b
- enable auto-round quantization model (#6226) · c8295d23
  Weiwei authored Sep 08, 2025
```
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
```
  c8295d23
05 Sep, 2025 1 commit
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
04 Sep, 2025 2 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- [Doc] Fix SGLang tool parser doc (#9886) · 75ee0011
  Huapeng Zhou authored Sep 04, 2025
  
  75ee0011
03 Sep, 2025 1 commit
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
02 Sep, 2025 1 commit
- [chore] fix dead links in doc (#9913) · 1fbfdebe
  Lifu Huang authored Sep 02, 2025
  
  1fbfdebe
29 Aug, 2025 1 commit
- [HiCache] change the default policy to write through (#9772) · 001f5194
  Zhiqiang Xie authored Aug 28, 2025
  
  001f5194
27 Aug, 2025 1 commit

[docs] Instructions for bench_serving.py (#9071) · a85363c1

yhyang201 authored Aug 27, 2025


Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

a85363c1

26 Aug, 2025 1 commit
- [doc] add kimik2 --tool-call-parser (#9647) · 1a0896e9
  Xiaotong Jiang authored Aug 26, 2025
  
  1a0896e9
25 Aug, 2025 1 commit
- [docs] Refactor, remove compiled results and add gpt-oss (#9613) · 9b08d975
  Chayenne authored Aug 25, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
```
  9b08d975
22 Aug, 2025 2 commits
- [Docs]Update reasoning parser doc & fix outdated link (#9492) · 13ec8d42
  Xinyuan Tong authored Aug 22, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  13ec8d42
- [docs]: fix reasoning context in docs (#9483) · 05bd7897
  Chayenne authored Aug 21, 2025
  
  05bd7897
20 Aug, 2025 1 commit
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8