Commits · fcc2e37f695b2b5e50476f5e063d83f9f3f7878e · change / sglang · GitLab

06 Mar, 2025 15 commits
- Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128) · fcc2e37f
  Lianmin Zheng authored Mar 06, 2025
  
  fcc2e37f
- remove unused max_jobs in setup_rocm.py (#4126) · 0804dd11
  Liu Jinjie authored Mar 06, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  0804dd11
- Add tag suffix to nightly docker builds. (#4129) · 55dc8e4d
  saienduri authored Mar 05, 2025
  
  55dc8e4d
- Add codeowners for eagle implementations (#4131) · 02e9e9f1
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <kssteven418@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  02e9e9f1
- Docs: improve EAGLE docs (#4038) · 8f0b6313
  simveit authored Mar 06, 2025
  
  8f0b6313
- feat: support docs auto live-reload with sphinx-autobuild (#4111) · b9b3b098
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  b9b3b098
- Add a pointer to the real KV cache pool (#4113) · aee30630
  Zhiqiang Xie authored Mar 05, 2025
  
  aee30630
- Remove prefill-only-one-req (#4117) · 286e6540
  Lianmin Zheng authored Mar 05, 2025
  
  286e6540
- [Hoxfix] Fix incomplete token_to_kv_pool refactor (#4121) · 718c391f
  Wenxuan Tan authored Mar 05, 2025
  
  718c391f
- chore: bump v0.4.3.post3 (#4114) · fc671f66
  Yineng Zhang authored Mar 05, 2025
  
  fc671f66
- fix Non-consecutive header level increase in docs/router/router.md (#4099) · 197751e9
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  197751e9
- fix cross-reference error and spelling mistakes (#4101) · d2d0d061
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  d2d0d061
- Online serving benchmarks of real datasets for hierarchical KV caching (#3211) · 25482edb
  Yueyang Pan authored Mar 06, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  25482edb
- Debug radixcache: refactor recursive helper methods (#3029) · 62b362b1
  luzengxiangcn authored Mar 06, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  62b362b1
- remove testing on PR workflow change (#4110) · 44d76463
  saienduri authored Mar 05, 2025
  
  44d76463
05 Mar, 2025 16 commits
- Create release-docker-amd-nightly.yml (#4105) · cd85b78f
  saienduri authored Mar 05, 2025
  
  cd85b78f
- revert deepseek docs (#4109) · 0aaccbbf
  Yineng Zhang authored Mar 05, 2025
  
  0aaccbbf
- Add examples for server token-in-token-out (#4103) · 357671e2
  Qiaolin Yu authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  357671e2
- Docs: reorganize dpsk docs (#4108) · e70fa279
  Chayenne authored Mar 05, 2025
  
  e70fa279
- Docs: Add DeepSeek optimization ablations documentation (#4107) · abe74b7b
  Tommy Yang authored Mar 06, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  abe74b7b
- Add update_weights_from_disk endpoint to Engine (#4102) · 70b3c6ee
  Jhin authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  70b3c6ee
- Fix triton kernel illegal memory issue for eagle (#4100) · ef9d3b3c
  Ke Bao authored Mar 06, 2025
  
  ef9d3b3c
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
- Fix the moe padding conditional logic (#4081) · 71ab0dab
  HAI authored Mar 05, 2025
  
  71ab0dab
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
- ROCM: AITER BLOCK GEMM (#4075) · 5be8f1ed
  yigex authored Mar 05, 2025
  
  5be8f1ed
- bench: add dataset param for bench_multiturn (#3990) · e5760bc4
  Lu Changqi authored Mar 05, 2025
  
  e5760bc4
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
04 Mar, 2025 9 commits
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
- Update nextn ci test (#4071) · 03b0364f
  Ke Bao authored Mar 05, 2025
  
  03b0364f
- Revert "Fix nightly-test CI" (#4065) · 2dd7d0c5
  Lianmin Zheng authored Mar 04, 2025
  
  2dd7d0c5
- [Feature] Add test for speculative_token_map (#4016) · 0d4e3228
  William authored Mar 04, 2025
  
  0d4e3228
- remove unused max_jobs (#3607) · 926f8efc
  Liu Jinjie authored Mar 04, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  926f8efc
- fix: support gelu_new activation function in gpt2 (#3712) · 9545bfb2
  Xiuyu Li authored Mar 04, 2025
  
  9545bfb2
- sgl-router - issues on routing and project build. (#3870) (#3948) · 37373ef2
  Michael Feil authored Mar 04, 2025
  
  37373ef2
- [XCCL] Use xccl for xpu backend since xccl is ready in latest PyTorch. (#3954) · 61261b39
  Chen Shengzhi authored Mar 04, 2025
  
  61261b39
- [Fix & Style] Refactor the grammar backend to reduce human errors and improve readability (#4030) · 19120f71
  DarkSharpness authored Mar 04, 2025
  
  19120f71