Commits · dbcf85b7f0c175d847fe435842f6910d08ca6add · change / sglang · GitLab

"vscode:/vscode.git/clone" did not exist on "fa71c5e276940fbede4fd9749b2505218315bced"

04 Nov, 2025 1 commit
- Add --speculative-moe-runner-backend server arg (#10183) · dbcf85b7
  Trevor Morris authored Nov 04, 2025
  
  dbcf85b7
26 Oct, 2025 1 commit
- Remove description for `--enable-beta-spec` argument (#12177) · 3f4cc0af
  Xinyuan Tong authored Oct 26, 2025
  
  3f4cc0af
24 Oct, 2025 1 commit
- docs(server-arguments): add allowed options for each argument (#11560) · 4b046a72
  Jonah Bernard authored Oct 24, 2025
  
  4b046a72
22 Oct, 2025 1 commit
- [Doc] Update deterministic inference flag in server_arguments.md (#11978) · 983ef22c
  Baizhou Zhang authored Oct 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  983ef22c
21 Oct, 2025 1 commit
- Rename flashmla kernel options of nsa backend for better readability (#11876) · ef4a8097
  Baizhou Zhang authored Oct 21, 2025
  
  ef4a8097
18 Oct, 2025 1 commit
- support server arg override KV cache to bf16 to avoid slow cases (#11749) · f9a7d9b3
  b8zhong authored Oct 18, 2025
  
  f9a7d9b3
15 Oct, 2025 1 commit
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
14 Oct, 2025 1 commit
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
12 Oct, 2025 1 commit
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
08 Oct, 2025 1 commit
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
06 Oct, 2025 1 commit
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
03 Oct, 2025 1 commit
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
02 Oct, 2025 1 commit
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
25 Sep, 2025 1 commit

Rename customer label -> custom label (#10899) · f68dd998

Lianmin Zheng authored Sep 25, 2025


Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f68dd998

24 Sep, 2025 1 commit

chore: Initial support for input config files (#10534) · d7b20dd6

kushanam authored Sep 24, 2025


Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

d7b20dd6

16 Sep, 2025 1 commit
- Fix formatting in long code blocks (#10528) · 7f028b07
  Philip Kiely - Baseten authored Sep 16, 2025
  
  7f028b07
09 Sep, 2025 1 commit
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
04 Sep, 2025 1 commit
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
29 Aug, 2025 1 commit
- [HiCache] change the default policy to write through (#9772) · 001f5194
  Zhiqiang Xie authored Aug 28, 2025
  
  001f5194
20 Aug, 2025 1 commit
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
11 Aug, 2025 2 commits
- Improve docs and developer guide (#9044) · 2e8e7e35
  Lianmin Zheng authored Aug 10, 2025
  
  2e8e7e35
- Refactor the docs (#9031) · 2449a0af
  Lianmin Zheng authored Aug 10, 2025
  
  2449a0af
09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
06 Aug, 2025 1 commit
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
03 Aug, 2025 2 commits
- [feat] support minimum token load balance in dp attention (#7379) · f7b2853f
  Guanhua Wang authored Aug 03, 2025
  
  f7b2853f
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
01 Aug, 2025 2 commits
- Add support for NCCL symmetric memory for TP allreduces (#8238) · 82e6c3a6
  Nicolas Castet authored Aug 01, 2025
  
  82e6c3a6
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
31 Jul, 2025 1 commit

model: support Step3V (#8583) · 51c38163

Chang Su authored Jul 31, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: nnnobody-code <nnnobody@foxmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Qiaolin-Yu <qy254@cornell.edu>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

51c38163

28 Jul, 2025 2 commits
- [NVIDIA] Change to use `num_local_experts` (#8453) · 134fa43e
  Kaixi Hou authored Jul 28, 2025
  
  134fa43e
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
19 Jul, 2025 2 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
11 Jul, 2025 1 commit
- Support Kimi K2 (#7940) · 61555307
  Atream authored Jul 11, 2025
  
  61555307
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
12 Jun, 2025 1 commit
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
11 Jun, 2025 1 commit
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca