Commits · 4e3defe5a77e14d70ad4ebfb3115ce507789f6e9 · change / sglang · GitLab

19 Jul, 2025 3 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
- Feat: Support audio in Phi4-mm model (#8048) · b7e951a6
  Binyao Jiang authored Jul 18, 2025
  
  b7e951a6
18 Jul, 2025 2 commits
- [Doc] Steps to add a new attention backend (#8155) · 9c7a4618
  Lianmin Zheng authored Jul 18, 2025
  
  9c7a4618
- Feat: Support Granite 3.0 MoE in SGLang (#7959) · 8a323557
  Minglei Zhu authored Jul 17, 2025
  
  8a323557
14 Jul, 2025 2 commits
- Support for Phi-1.5 & Phi-2 models (#7862) · cb736df8
  Praneth Paruchuri authored Jul 14, 2025
  
  cb736df8
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
12 Jul, 2025 2 commits
- docs: update README (#7985) · 22bd857c
  Yineng Zhang authored Jul 12, 2025
  
  22bd857c
- chore: bump v0.4.9.post2 (#7963) · eb118d88
  Yineng Zhang authored Jul 11, 2025
  
  eb118d88
11 Jul, 2025 2 commits
- [feature] kv transfer support of ascend npu (#7795) · 86044712
  ronnie_zheng authored Jul 11, 2025
```
Co-authored-by: liupeng <liupeng374@huawei.com>
```
  86044712
- Support Kimi K2 (#7940) · 61555307
  Atream authored Jul 11, 2025
  
  61555307
10 Jul, 2025 1 commit
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
09 Jul, 2025 3 commits
- chore: bump v0.4.9.post1 (#7882) · 066f4ec9
  Yineng Zhang authored Jul 09, 2025
  
  066f4ec9
- Update native_api doc to match the change in the `get_model_info` endpoint (#7660) · 08702321
  Yikai Zhang authored Jul 09, 2025
```
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  08702321
- [PD] Add guidance for prefill bootstrap timeout (#7846) · 64c5907e
  Shangming Cai authored Jul 09, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  64c5907e
08 Jul, 2025 1 commit
- Support Mimo-VL (#7579) · 43e20c06
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43e20c06
06 Jul, 2025 1 commit
- chore: bump v0.4.9 (#7802) · ec5f9c62
  Yineng Zhang authored Jul 05, 2025
  
  ec5f9c62
04 Jul, 2025 1 commit
- fix(docs): fix the broken link in `docs/references/production_metrics.md` (#7741) · 1e3e3add
  Yuchen Cheng authored Jul 04, 2025
```
Signed-off-by: rudeigerc <rudeigerc@gmail.com>
```
  1e3e3add
03 Jul, 2025 2 commits
- fix CI: update native api ipynb (#7754) · 43f93f63
  Xinyuan Tong authored Jul 03, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  43f93f63
- Ascend attention backend(PA&MLA) (#7722) · 1e0e5497
  ronnie_zheng authored Jul 03, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>
```
  1e0e5497
01 Jul, 2025 2 commits
- add description for llama4 eagle3 (#7688) · 93b6785d
  Yi Zhang authored Jul 01, 2025
  
  93b6785d
- [doc] update lws doc for pd (#7318) · 7349717e
  ybyang authored Jul 01, 2025
  
  7349717e
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

Hybrid kv cache for LLaMA4 (#6563) · eb6c2c16

tarinkk authored Jun 27, 2025


Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

eb6c2c16

26 Jun, 2025 2 commits
- chore: bump v0.4.8.post1 (#7559) · 69183f88
  Yineng Zhang authored Jun 26, 2025
  
  69183f88
- [PD] Raise error for incompatible mooncake version and some minor fixes (#7527) · 5c214257
  Shangming Cai authored Jun 26, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  5c214257
24 Jun, 2025 1 commit
- chore: bump v0.4.8 (#7493) · 7c3a12c0
  Yineng Zhang authored Jun 23, 2025
  
  7c3a12c0
23 Jun, 2025 1 commit
- Update hyperparameter_tuning.md (#7454) · 30ceccc7
  Lianmin Zheng authored Jun 22, 2025
  
  30ceccc7
21 Jun, 2025 2 commits
- feat(oai refactor): Replace `openai_api` with `entrypoints/openai` (#7351) · 72676cd6
  Chang Su authored Jun 21, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
```
  72676cd6
- Remove batches api in docs & example (#7400) · ab74f8f0
  Jinn authored Jun 20, 2025
  
  ab74f8f0
20 Jun, 2025 1 commit
- [Doc] add embedding rerank doc (#7364) · 97011abc
  woodx authored Jun 20, 2025
  
  97011abc
19 Jun, 2025 1 commit
- docs: update installation (#7366) · fadf18fd
  Yineng Zhang authored Jun 19, 2025
  
  fadf18fd
18 Jun, 2025 1 commit
- update invalid link in doc (#7297) · 1de4db9b
  linzhuo authored Jun 18, 2025
  
  1de4db9b
17 Jun, 2025 1 commit
- support qwen2 running on ascend npu device (#7022) · a39d9287
  Yijie Zhu authored Jun 18, 2025
```
Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>
```
  a39d9287
16 Jun, 2025 2 commits
- chore: bump v0.4.7.post1 (#7248) · f9dc9dd2
  Yineng Zhang authored Jun 16, 2025
  
  f9dc9dd2
- Minor style and doc fix (#7228) · 21615cc3
  Lianmin Zheng authored Jun 16, 2025
  
  21615cc3
14 Jun, 2025 1 commit
- Add Phi-4-mm to supported VLM supported model list. (#7178) · 98538822
  Lifu Huang authored Jun 13, 2025
  
  98538822
12 Jun, 2025 1 commit
- [Fix] Reduce busy polling when scheduler is idle (#6026) · bd7cfbd2
  Povilas Kanapickas authored Jun 13, 2025
  
  bd7cfbd2
11 Jun, 2025 2 commits
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66