Commits · dbcf85b7f0c175d847fe435842f6910d08ca6add · change / sglang

04 Nov, 2025 1 commit
- Add --speculative-moe-runner-backend server arg (#10183) · dbcf85b7
  Trevor Morris authored Nov 04, 2025
  
  dbcf85b7
03 Nov, 2025 1 commit
- update usage of `trtllm_fp8_per_tensor_scale_moe` (#12569) · d31d48b3
  b8zhong authored Nov 03, 2025
  
  d31d48b3
31 Oct, 2025 1 commit
- Revert "fix llama4 kv cache layout" (#12437) · a076ec1a
  b8zhong authored Oct 30, 2025
  
  a076ec1a
30 Oct, 2025 1 commit
- [Ckpt Engine] feat: new sglang entrypoint support for update (#12216) · 32438eba
  Teng Ma authored Oct 30, 2025
  
  32438eba
27 Oct, 2025 1 commit
- Add support for AutoRound quantized models (#10153) · caa4819b
  Weiwei authored Oct 27, 2025
  
  caa4819b
26 Oct, 2025 1 commit
- Remove description for `--enable-beta-spec` argument (#12177) · 3f4cc0af
  Xinyuan Tong authored Oct 26, 2025
  
  3f4cc0af
25 Oct, 2025 1 commit

[Doc] Add documentation for DeepSeek V3.2 (#11877) · 729b2429

Baizhou Zhang authored Oct 24, 2025


Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>

729b2429

24 Oct, 2025 1 commit
- docs(server-arguments): add allowed options for each argument (#11560) · 4b046a72
  Jonah Bernard authored Oct 24, 2025
  
  4b046a72
22 Oct, 2025 3 commits
- [Doc] Update deterministic inference flag in server_arguments.md (#11978) · 983ef22c
  Baizhou Zhang authored Oct 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  983ef22c
- [Documentation] add doc for deterministic inference (#11956) · 200a3c0b
  Minglei Zhu authored Oct 22, 2025
  
  200a3c0b
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 3 commits
- Rename flashmla kernel options of nsa backend for better readability (#11876) · ef4a8097
  Baizhou Zhang authored Oct 21, 2025
  
  ef4a8097
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
20 Oct, 2025 3 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- Tiny clean up for PD module and doc (#11747) · a2ba0bc3
  Shangming Cai authored Oct 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a2ba0bc3
- [Doc] Update documents for FA4 (#11778) · 44f0ece9
  Baizhou Zhang authored Oct 19, 2025
  
  44f0ece9
18 Oct, 2025 1 commit
- support server arg override KV cache to bf16 to avoid slow cases (#11749) · f9a7d9b3
  b8zhong authored Oct 18, 2025
  
  f9a7d9b3
17 Oct, 2025 1 commit
- [doc] update router document (#11767) · 2bc3fcd4
  Keyang Ru authored Oct 17, 2025
  
  2bc3fcd4
15 Oct, 2025 3 commits
- [Doc] Update support matrix for attn and hybrid attn (#11293) · 6bc503af
  b8zhong authored Oct 14, 2025
  
  6bc503af
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
- [router] update router doc to latest features (#11639) · e0c2af2a
  Simo Lin authored Oct 14, 2025
  
  e0c2af2a
14 Oct, 2025 3 commits
- [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) · 642fa966
  Wenyi Xu authored Oct 14, 2025
  
  642fa966
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
13 Oct, 2025 2 commits
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- docs(router): add token-bucket rate limiting to the docs (#11485) · 8e776c78
  Jonah Bernard authored Oct 12, 2025
  
  8e776c78
12 Oct, 2025 1 commit
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
11 Oct, 2025 1 commit
- [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) · f5754d12
  ykcombat authored Oct 11, 2025
  
  f5754d12
08 Oct, 2025 2 commits
- [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) · 0a7c4bde
  Shangming Cai authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  0a7c4bde
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
07 Oct, 2025 4 commits
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
06 Oct, 2025 1 commit
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
03 Oct, 2025 1 commit
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
02 Oct, 2025 1 commit
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
30 Sep, 2025 1 commit
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 1 commit
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f