Commits · 2272c2a5b5025b3c7aae9291cbf3e5cb868556dd · change / sglang

26 Jul, 2025 1 commit
- chore: bump v0.4.9.post4 (#8305) · 2272c2a5
  Yineng Zhang authored Jul 25, 2025
  
  2272c2a5
25 Jul, 2025 3 commits
- [Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363) · d8ee1564
  Chang Su authored Jul 25, 2025
  
  d8ee1564
- [torch.compile bug] avoid biased_grouped_topk_impl func repeatedly triggering... · 9045cc1e
  Xiaoyu Zhang authored Jul 25, 2025
```
[torch.compile bug] avoid biased_grouped_topk_impl func repeatedly triggering `torch.compile` in forward pass (#8353)
```
  9045cc1e
- [CPU] Add tutorial docs for SGL on CPU (#8000) · 15d27591
  Zaili Wang authored Jul 25, 2025
  
  15d27591
22 Jul, 2025 1 commit
- chore: bump v0.4.9.post3 (#8265) · 01c00004
  Yineng Zhang authored Jul 22, 2025
  
  01c00004
21 Jul, 2025 1 commit
- [Refactor] simplify multimodal data processing (#8107) · 8430bfe3
  Xinyuan Tong authored Jul 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8430bfe3
20 Jul, 2025 1 commit
- Feat: Support for Persimmon Model (#7983) · 83c104b1
  Praneth Paruchuri authored Jul 20, 2025
  
  83c104b1
19 Jul, 2025 3 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
- Feat: Support audio in Phi4-mm model (#8048) · b7e951a6
  Binyao Jiang authored Jul 18, 2025
  
  b7e951a6
18 Jul, 2025 2 commits
- [Doc] Steps to add a new attention backend (#8155) · 9c7a4618
  Lianmin Zheng authored Jul 18, 2025
  
  9c7a4618
- Feat: Support Granite 3.0 MoE in SGLang (#7959) · 8a323557
  Minglei Zhu authored Jul 17, 2025
  
  8a323557
14 Jul, 2025 2 commits
- Support for Phi-1.5 & Phi-2 models (#7862) · cb736df8
  Praneth Paruchuri authored Jul 14, 2025
  
  cb736df8
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
12 Jul, 2025 2 commits
- docs: update README (#7985) · 22bd857c
  Yineng Zhang authored Jul 12, 2025
  
  22bd857c
- chore: bump v0.4.9.post2 (#7963) · eb118d88
  Yineng Zhang authored Jul 11, 2025
  
  eb118d88
11 Jul, 2025 2 commits
- [feature] kv transfer support of ascend npu (#7795) · 86044712
  ronnie_zheng authored Jul 11, 2025
```
Co-authored-by: liupeng <liupeng374@huawei.com>
```
  86044712
- Support Kimi K2 (#7940) · 61555307
  Atream authored Jul 11, 2025
  
  61555307
10 Jul, 2025 1 commit
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
09 Jul, 2025 3 commits
- chore: bump v0.4.9.post1 (#7882) · 066f4ec9
  Yineng Zhang authored Jul 09, 2025
  
  066f4ec9
- Update native_api doc to match the change in the `get_model_info` endpoint (#7660) · 08702321
  Yikai Zhang authored Jul 09, 2025
```
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  08702321
- [PD] Add guidance for prefill bootstrap timeout (#7846) · 64c5907e
  Shangming Cai authored Jul 09, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  64c5907e
08 Jul, 2025 1 commit
- Support Mimo-VL (#7579) · 43e20c06
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43e20c06
06 Jul, 2025 1 commit
- chore: bump v0.4.9 (#7802) · ec5f9c62
  Yineng Zhang authored Jul 05, 2025
  
  ec5f9c62
04 Jul, 2025 1 commit
- fix(docs): fix the broken link in `docs/references/production_metrics.md` (#7741) · 1e3e3add
  Yuchen Cheng authored Jul 04, 2025
```
Signed-off-by: rudeigerc <rudeigerc@gmail.com>
```
  1e3e3add
03 Jul, 2025 2 commits
- fix CI: update native api ipynb (#7754) · 43f93f63
  Xinyuan Tong authored Jul 03, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43f93f63
- Ascend attention backend(PA&MLA) (#7722) · 1e0e5497
  ronnie_zheng authored Jul 03, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  1e0e5497
01 Jul, 2025 2 commits
- add description for llama4 eagle3 (#7688) · 93b6785d
  Yi Zhang authored Jul 01, 2025
  
  93b6785d
- [doc] update lws doc for pd (#7318) · 7349717e
  ybyang authored Jul 01, 2025
  
  7349717e
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

Hybrid kv cache for LLaMA4 (#6563) · eb6c2c16

tarinkk authored Jun 27, 2025


Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

eb6c2c16

26 Jun, 2025 2 commits
- chore: bump v0.4.8.post1 (#7559) · 69183f88
  Yineng Zhang authored Jun 26, 2025
  
  69183f88
- [PD] Raise error for incompatible mooncake version and some minor fixes (#7527) · 5c214257
  Shangming Cai authored Jun 26, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  5c214257
24 Jun, 2025 1 commit
- chore: bump v0.4.8 (#7493) · 7c3a12c0
  Yineng Zhang authored Jun 23, 2025
  
  7c3a12c0
23 Jun, 2025 1 commit
- Update hyperparameter_tuning.md (#7454) · 30ceccc7
  Lianmin Zheng authored Jun 22, 2025
  
  30ceccc7
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- Remove batches api in docs & example (#7400) · ab74f8f0
  Jinn authored Jun 20, 2025
  
  ab74f8f0
20 Jun, 2025 1 commit
- [Doc] add embedding rerank doc (#7364) · 97011abc
  woodx authored Jun 20, 2025
  
  97011abc
19 Jun, 2025 1 commit
- docs: update installation (#7366) · fadf18fd
  Yineng Zhang authored Jun 19, 2025
  
  fadf18fd
18 Jun, 2025 1 commit
- update invalid link in doc (#7297) · 1de4db9b
  linzhuo authored Jun 18, 2025
  
  1de4db9b