Commits · 23c764b18aeb37c42ddedd7468f1a5753df1f232 · change / sglang

01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

29 Mar, 2025 3 commits
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
- bump v0.4.4.post3 (#4878) · 19e96e59
  Yineng Zhang authored Mar 28, 2025
  
  19e96e59
- update torch compile doc (#4874) · aa08aeac
  Ke Bao authored Mar 29, 2025
  
  aa08aeac
28 Mar, 2025 2 commits
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 5 commits
- Update doc for DeepSeek-V3-0324 (#4825) · b3953258
  Ke Bao authored Mar 28, 2025
  
  b3953258
- [k8s] Clarified the usage of shared memory. (#4341) · f60f2931
  Jiří Suchomel authored Mar 27, 2025
  
  f60f2931
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
- Update supported_models.md: adding open-r1 Olympic Code 32B by HuggingFace (#4628) · 44f47d3e
  Didier Durand authored Mar 27, 2025
  
  44f47d3e
- bump v0.4.4.post2 (#4669) · 1099f6c9
  Yineng Zhang authored Mar 26, 2025
  
  1099f6c9
25 Mar, 2025 4 commits
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
22 Mar, 2025 3 commits
- fix typo SGLang supports three grammar backends (#4679) · 8796cebb
  BroadbentJim authored Mar 22, 2025
  
  8796cebb
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
- fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) · f6ab4ca6
  mlmz authored Mar 22, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  f6ab4ca6
21 Mar, 2025 1 commit
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
20 Mar, 2025 1 commit
- Update doc for MTP and DP attention (#4622) · bfb03c61
  Ke Bao authored Mar 21, 2025
  
  bfb03c61
19 Mar, 2025 1 commit

[Feature] Integrate DeepEP into SGLang (#4232) · f44db16c

Jinyan Chen authored Mar 19, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>

f44db16c

18 Mar, 2025 2 commits
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
- Fix the incorrect args in benchmark_and_profiling.md (#4542) · 2d004512
  Albert authored Mar 18, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
```
  2d004512
17 Mar, 2025 7 commits
- Update readme (#4517) · c38ca4fc
  Lianmin Zheng authored Mar 17, 2025
  
  c38ca4fc
- [Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495) · f2ab37e5
  HandH1998 authored Mar 17, 2025
  
  f2ab37e5
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Constraint Decoding: Set xgrammar as the default grammar backend (#4386) · 452db508
  mlmz authored Mar 17, 2025
  
  452db508
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
15 Mar, 2025 3 commits
- typos: Update sampling_params.md (#4391) · 22c96f78
  Wang Ran (汪然) authored Mar 16, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  22c96f78
- docs: Add Llama 3.3 to supported models (#4453) · 26c372c1
  江家瑋 authored Mar 16, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  26c372c1
- docs: hot fix torch compile cache (#4442) · e1a5e7e4
  Chayenne authored Mar 14, 2025
  
  e1a5e7e4
14 Mar, 2025 2 commits
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
- bump v0.4.4.post1 (#4402) · ba80c102
  Yineng Zhang authored Mar 13, 2025
  
  ba80c102
13 Mar, 2025 5 commits
- chore: bump v0.4.4 (#4041) · 6aaeb848
  Yineng Zhang authored Mar 13, 2025
  
  6aaeb848
- Revert "[XPU][CPU] Enable the native path of DeepSeek" (#4367) · 45de8971
  Lianmin Zheng authored Mar 12, 2025
  
  45de8971
- [XPU][CPU] Enable the native path of DeepSeek (#4086) · 71046fcd
  Meng, Hengyu authored Mar 13, 2025
```
Co-authored-by: Zhang, Liangang <liangang.zhang@intel.com>
```
  71046fcd
- [Doc] Fix typo in backend/sampling_params (#3835) · ad46550d
  yang_zcybb authored Mar 13, 2025
```
Co-authored-by: yangzhice.124 <yangzhice.124@bytedance.com>
```
  ad46550d
- [docs] Update outdated description about `torch.compile` (#3844) · 14344caa
  Jun Liu authored Mar 13, 2025
  
  14344caa