Commits · f9a7d9b3dcf33ff7611b9f57ed729e6f19333da5 · change / sglang · GitLab

"vscode:/vscode.git/clone" did not exist on "66003e1d05874703b425717bc39f112fcb88136a"

18 Oct, 2025 1 commit
- support server arg override KV cache to bf16 to avoid slow cases (#11749) · f9a7d9b3
  b8zhong authored Oct 18, 2025
  
  f9a7d9b3
15 Oct, 2025 1 commit
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
14 Oct, 2025 1 commit
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
12 Oct, 2025 1 commit
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
08 Oct, 2025 1 commit
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
06 Oct, 2025 1 commit
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
03 Oct, 2025 1 commit
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
02 Oct, 2025 1 commit
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
25 Sep, 2025 1 commit

Rename customer label -> custom label (#10899) · f68dd998

Lianmin Zheng authored Sep 25, 2025


Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f68dd998

24 Sep, 2025 1 commit

chore: Initial support for input config files (#10534) · d7b20dd6

kushanam authored Sep 24, 2025


Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

d7b20dd6

16 Sep, 2025 1 commit
- Fix formatting in long code blocks (#10528) · 7f028b07
  Philip Kiely - Baseten authored Sep 16, 2025
  
  7f028b07
09 Sep, 2025 1 commit
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
04 Sep, 2025 1 commit
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
29 Aug, 2025 1 commit
- [HiCache] change the default policy to write through (#9772) · 001f5194
  Zhiqiang Xie authored Aug 28, 2025
  
  001f5194
20 Aug, 2025 1 commit
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
11 Aug, 2025 2 commits
- Improve docs and developer guide (#9044) · 2e8e7e35
  Lianmin Zheng authored Aug 10, 2025
  
  2e8e7e35
- Refactor the docs (#9031) · 2449a0af
  Lianmin Zheng authored Aug 10, 2025
  
  2449a0af
09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
06 Aug, 2025 1 commit
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
03 Aug, 2025 2 commits
- [feat] support minimum token load balance in dp attention (#7379) · f7b2853f
  Guanhua Wang authored Aug 03, 2025
  
  f7b2853f
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
01 Aug, 2025 2 commits
- Add support for NCCL symmetric memory for TP allreduces (#8238) · 82e6c3a6
  Nicolas Castet authored Aug 01, 2025
  
  82e6c3a6
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
31 Jul, 2025 1 commit

model: support Step3V (#8583) · 51c38163

Chang Su authored Jul 31, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: nnnobody-code <nnnobody@foxmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Qiaolin-Yu <qy254@cornell.edu>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

51c38163

28 Jul, 2025 2 commits
- [NVIDIA] Change to use `num_local_experts` (#8453) · 134fa43e
  Kaixi Hou authored Jul 28, 2025
  
  134fa43e
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
19 Jul, 2025 2 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
11 Jul, 2025 1 commit
- Support Kimi K2 (#7940) · 61555307
  Atream authored Jul 11, 2025
  
  61555307
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
12 Jun, 2025 1 commit
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
11 Jun, 2025 2 commits
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66
10 Jun, 2025 1 commit
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
12 May, 2025 1 commit
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd