Commits · 1099f6c9748752eee30081d3eaed4cf64a708f45 · change / sglang

27 Mar, 2025 1 commit
- bump v0.4.4.post2 (#4669) · 1099f6c9
  Yineng Zhang authored Mar 26, 2025
  
  1099f6c9
25 Mar, 2025 4 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
22 Mar, 2025 3 commits
- fix typo SGLang supports three grammar backends (#4679) · 8796cebb
  BroadbentJim authored Mar 22, 2025
  
  8796cebb
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
- fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) · f6ab4ca6
  mlmz authored Mar 22, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  f6ab4ca6
21 Mar, 2025 1 commit
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
20 Mar, 2025 1 commit
- Update doc for MTP and DP attention (#4622) · bfb03c61
  Ke Bao authored Mar 21, 2025
  
  bfb03c61
19 Mar, 2025 1 commit

[Feature] Integrate DeepEP into SGLang (#4232) · f44db16c

Jinyan Chen authored Mar 19, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>

f44db16c

18 Mar, 2025 2 commits
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
- Fix the incorrect args in benchmark_and_profiling.md (#4542) · 2d004512
  Albert authored Mar 18, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
```
  2d004512
17 Mar, 2025 7 commits
- Update readme (#4517) · c38ca4fc
  Lianmin Zheng authored Mar 17, 2025
  
  c38ca4fc
- [Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495) · f2ab37e5
  HandH1998 authored Mar 17, 2025
  
  f2ab37e5
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Constraint Decoding: Set xgrammar as the default grammar backend (#4386) · 452db508
  mlmz authored Mar 17, 2025
  
  452db508
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
15 Mar, 2025 3 commits
- typos: Update sampling_params.md (#4391) · 22c96f78
  Wang Ran (汪然) authored Mar 16, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  22c96f78
- docs: Add Llama 3.3 to supported models (#4453) · 26c372c1
  江家瑋 authored Mar 16, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  26c372c1
- docs: hot fix torch compile cache (#4442) · e1a5e7e4
  Chayenne authored Mar 14, 2025
  
  e1a5e7e4
14 Mar, 2025 2 commits
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
- bump v0.4.4.post1 (#4402) · ba80c102
  Yineng Zhang authored Mar 13, 2025
  
  ba80c102
13 Mar, 2025 7 commits
- chore: bump v0.4.4 (#4041) · 6aaeb848
  Yineng Zhang authored Mar 13, 2025
  
  6aaeb848
- Revert "[XPU][CPU] Enable the native path of DeepSeek" (#4367) · 45de8971
  Lianmin Zheng authored Mar 12, 2025
  
  45de8971
- [XPU][CPU] Enable the native path of DeepSeek (#4086) · 71046fcd
  Meng, Hengyu authored Mar 13, 2025
```
Co-authored-by: Zhang, Liangang <liangang.zhang@intel.com>
```
  71046fcd
- [Doc] Fix typo in backend/sampling_params (#3835) · ad46550d
  yang_zcybb authored Mar 13, 2025
```
Co-authored-by: yangzhice.124 <yangzhice.124@bytedance.com>
```
  ad46550d
- [docs] Update outdated description about `torch.compile` (#3844) · 14344caa
  Jun Liu authored Mar 13, 2025
  
  14344caa
- Fix the doc of FR-Spec (#4295) · 0a59a465
  William authored Mar 13, 2025
  
  0a59a465
- docs: add parameter --log-requests-level (#4335) · 01603318
  Peter Pan authored Mar 13, 2025
  
  01603318
12 Mar, 2025 3 commits
- [Fix Doc.] Enable internal forwarding when starting the router (#4355) · 2c3656f2
  shizhediao authored Mar 12, 2025
  
  2c3656f2
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
- [Docs] Clean up benchmark_and_profiling.md (#4297) · 8f1f614e
  Michael Yao authored Mar 12, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  8f1f614e
11 Mar, 2025 3 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- update doc (#4299) · 00f42707
  Yineng Zhang authored Mar 11, 2025
  
  00f42707
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
09 Mar, 2025 2 commits
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f