Commits · 76c48a0913b993bb185f4c4c2d884b28689e0007 · zhaoyu6 / sglang

08 Apr, 2025 1 commit
- feat: disable grammar restrictions within reasoning sections (#4984) · 7c5658c1
  mlmz authored Apr 08, 2025
```
Co-authored-by: tianhaoyu <thy@mail.ecust.edu.cn>
Co-authored-by: DarkSharpness <2040703891@qq.com>
```
  7c5658c1
02 Apr, 2025 1 commit
- Large page size aligned hierarchical caching (#4581) · e119f042
  Zhiqiang Xie authored Apr 01, 2025
  
  e119f042
31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
30 Mar, 2025 1 commit
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
28 Mar, 2025 5 commits
- Fix wrong variable name when stopping memory profile (#4772) · c483377e
  Fr4nk1in authored Mar 29, 2025
  
  c483377e
- Support with_stack and record_shapes in profiler (#4740) · 8c04f0f2
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  8c04f0f2
- Support controlling nsys start and end range programmatically (#4688) · 53a2c3b4
  fzyzcjy authored Mar 28, 2025
  
  53a2c3b4
- [Fix] `self.worker` assignment in `TpModelWorker` and refactor references (#4788) · 42a45df0
  XinyuanTong authored Mar 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  42a45df0
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
26 Mar, 2025 2 commits
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
- Warn users when release_memory_occupation is called without memory saver enabled (#4566) · 26f07294
  fzyzcjy authored Mar 26, 2025
  
  26f07294
25 Mar, 2025 3 commits
- Fix test_expert_distribution failure (#4752) · eb934bdf
  fzyzcjy authored Mar 25, 2025
  
  eb934bdf
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
21 Mar, 2025 1 commit

[PD] Release initial code (#4654) · c7c7dbeb

Byron Hsu authored Mar 21, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai

c7c7dbeb

18 Mar, 2025 1 commit
- Unit test for Hierarchical Caching (#4486) · a98290ae
  Zhiqiang Xie authored Mar 17, 2025
  
  a98290ae
17 Mar, 2025 2 commits
- Fix data parallel + tensor parallel (#4499) · 5493c334
  Lianmin Zheng authored Mar 17, 2025
  
  5493c334
- [Fix] use `torch.inference_mode()` instead of `torch.no_grad()` (#4372) · 0212d2e2
  JieXin Liang authored Mar 17, 2025
  
  0212d2e2
16 Mar, 2025 1 commit
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
14 Mar, 2025 1 commit
- feat(remote_model): support variable remote backend for model loader (#3964) · 1ce4878d
  wangyu authored Mar 14, 2025
```
Signed-off-by: wangyu <wangyu.steph@bytedance.com>
```
  1ce4878d
13 Mar, 2025 4 commits
- Hot fix for hicache with new page aligned radixtree (#4397) · fbdb5050
  Zhiqiang Xie authored Mar 13, 2025
  
  fbdb5050
- Improve DP attention (#4390) · 8e66fbec
  Lianmin Zheng authored Mar 13, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  8e66fbec
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
- Fix scheduler proctitle suffix is None (#4326) · c550e52f
  文峰 authored Mar 13, 2025
```
Co-authored-by: wenfeng.wf <wenfeng.wf@alibaba-inc.com>
```
  c550e52f
12 Mar, 2025 2 commits
- Move output processing logic from scheduler.py into a separate file (#4354) · e35a93fa
  Lianmin Zheng authored Mar 12, 2025
  
  e35a93fa
- Hierarchical Caching Refactoring and Fixing TP issue (#4082) · 10b544ae
  Zhiqiang Xie authored Mar 12, 2025
  
  10b544ae
08 Mar, 2025 1 commit

[EAGLE] many fixes for eagle (#4195) · d4017a6b

Lianmin Zheng authored Mar 07, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

d4017a6b

07 Mar, 2025 2 commits
- Fix eagle hang issue for max_new_tokens=1 (#4185) · 20c81199
  Ke Bao authored Mar 08, 2025
  
  20c81199
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
06 Mar, 2025 3 commits
- Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128) · fcc2e37f
  Lianmin Zheng authored Mar 06, 2025
  
  fcc2e37f
- Remove prefill-only-one-req (#4117) · 286e6540
  Lianmin Zheng authored Mar 05, 2025
  
  286e6540
- [Hoxfix] Fix incomplete token_to_kv_pool refactor (#4121) · 718c391f
  Wenxuan Tan authored Mar 05, 2025
  
  718c391f
05 Mar, 2025 2 commits
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
03 Mar, 2025 3 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50