Commits · ab9187a20bc87c4dfa934b6a8347b26fb6ae73ab · change / sglang

15 Oct, 2025 4 commits
- docs: update sglang installation guide (#11659) · ab9187a2
  Yineng Zhang authored Oct 15, 2025
  
  ab9187a2
- [Doc] Update support matrix for attn and hybrid attn (#11293) · 6bc503af
  b8zhong authored Oct 14, 2025
  
  6bc503af
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
- [router] update router doc to latest features (#11639) · e0c2af2a
  Simo Lin authored Oct 14, 2025
  
  e0c2af2a
14 Oct, 2025 5 commits
- Update install.md (#11631) · d314bf60
  Lianmin Zheng authored Oct 14, 2025
  
  d314bf60
- [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) · 642fa966
  Wenyi Xu authored Oct 14, 2025
  
  642fa966
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
- [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) · aaf7af1b
  Neelabh Sinha authored Oct 13, 2025
  
  aaf7af1b
13 Oct, 2025 3 commits
- Move deep gemm related arguments to `sglang.srt.environ` (#11547) · acc2327b
  Liangsheng Yin authored Oct 14, 2025
  
  acc2327b
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- docs(router): add token-bucket rate limiting to the docs (#11485) · 8e776c78
  Jonah Bernard authored Oct 12, 2025
  
  8e776c78
12 Oct, 2025 2 commits
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 1 commit
- [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) · f5754d12
  ykcombat authored Oct 11, 2025
  
  f5754d12
10 Oct, 2025 1 commit
- Dedicated toml files for CPU/XPU (#10734) · f19613e6
  Zaili Wang authored Oct 10, 2025
  
  f19613e6
09 Oct, 2025 1 commit
- chore: bump SGLang version to 0.5.3.post1 (#11324) · 758b887a
  sglang-bot authored Oct 09, 2025
  
  758b887a
08 Oct, 2025 6 commits
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
- benchmark: enhance configurable multimodal benchmarking in bench_serving (#9812) · e3bb7f5a
  Kevin Xiang Li authored Oct 08, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  e3bb7f5a
- [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) · 0a7c4bde
  Shangming Cai authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  0a7c4bde
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
- [Feature] Add /tokenize and /detokenize OpenAI compatible endpoints (#9545) · 7c3f07db
  Adarsh Shirawalmath authored Oct 08, 2025
  
  7c3f07db
- update sampling_params documentation with defaults (#11315) · c4d77774
  Xinyuan Tong authored Oct 07, 2025
  
  c4d77774
07 Oct, 2025 4 commits
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
06 Oct, 2025 4 commits
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823
- chore: bump SGLang version to 0.5.3rc2 (#11259) · 0b13cbb7
  sglang-bot authored Oct 06, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  0b13cbb7
- Rename runner labels (#11228) · d645ae90
  Lianmin Zheng authored Oct 05, 2025
  
  d645ae90
03 Oct, 2025 2 commits
- model: support starcoder2 (#10609) · fad7ca73
  Praneth Paruchuri authored Oct 03, 2025
  
  fad7ca73
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
02 Oct, 2025 1 commit
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
01 Oct, 2025 1 commit
- [Doc] Update multimodal language models documentation (#11111) · a9ce2bcb
  Xinyuan Tong authored Sep 30, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  a9ce2bcb
30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 1 commit
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
25 Sep, 2025 1 commit

Rename customer label -> custom label (#10899) · f68dd998

Lianmin Zheng authored Sep 25, 2025


Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f68dd998

24 Sep, 2025 2 commits
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- Add CI timeout guidelines (#10829) · b1f0fc1c
  Lianmin Zheng authored Sep 23, 2025
  
  b1f0fc1c