Commits · 23c764b18aeb37c42ddedd7468f1a5753df1f232 · change / sglang

01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

29 Mar, 2025 1 commit
- update torch compile doc (#4874) · aa08aeac
  Ke Bao authored Mar 29, 2025
  
  aa08aeac
28 Mar, 2025 2 commits
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 1 commit
- [k8s] Clarified the usage of shared memory. (#4341) · f60f2931
  Jiří Suchomel authored Mar 27, 2025
  
  f60f2931
25 Mar, 2025 1 commit
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
22 Mar, 2025 3 commits
- fix typo SGLang supports three grammar backends (#4679) · 8796cebb
  BroadbentJim authored Mar 22, 2025
  
  8796cebb
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
- fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) · f6ab4ca6
  mlmz authored Mar 22, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  f6ab4ca6
19 Mar, 2025 1 commit

[Feature] Integrate DeepEP into SGLang (#4232) · f44db16c

Jinyan Chen authored Mar 19, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>

f44db16c

18 Mar, 2025 1 commit
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
17 Mar, 2025 3 commits
- [Doc] add doc for quantization w8a8_fp8 or w8a8_int8 (#4495) · f2ab37e5
  HandH1998 authored Mar 17, 2025
  
  f2ab37e5
- Constraint Decoding: Tool call with text (#4067) · 927ca935
  Xihuai Wang authored Mar 17, 2025
  
  927ca935
- Constraint Decoding: Set xgrammar as the default grammar backend (#4386) · 452db508
  mlmz authored Mar 17, 2025
  
  452db508
15 Mar, 2025 2 commits
- typos: Update sampling_params.md (#4391) · 22c96f78
  Wang Ran (汪然) authored Mar 16, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  22c96f78
- docs: hot fix torch compile cache (#4442) · e1a5e7e4
  Chayenne authored Mar 14, 2025
  
  e1a5e7e4
13 Mar, 2025 4 commits
- [Doc] Fix typo in backend/sampling_params (#3835) · ad46550d
  yang_zcybb authored Mar 13, 2025
```
Co-authored-by: yangzhice.124 <yangzhice.124@bytedance.com>
```
  ad46550d
- [docs] Update outdated description about `torch.compile` (#3844) · 14344caa
  Jun Liu authored Mar 13, 2025
  
  14344caa
- Fix the doc of FR-Spec (#4295) · 0a59a465
  William authored Mar 13, 2025
  
  0a59a465
- docs: add parameter --log-requests-level (#4335) · 01603318
  Peter Pan authored Mar 13, 2025
  
  01603318
11 Mar, 2025 1 commit
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
09 Mar, 2025 1 commit
- docs(reasoning content): 📝 deepseek-r1 parser support qwq (#4124) · 6eec3cdc
  Xihuai Wang authored Mar 09, 2025
  
  6eec3cdc
07 Mar, 2025 1 commit
- [Docs] Fix links and grammar issues (#4162) · d557319a
  Michael Yao authored Mar 07, 2025
  
  d557319a
06 Mar, 2025 4 commits
- Hot fix small vocal eagle in docs (#4154) · 9854a18a
  Chayenne authored Mar 06, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  9854a18a
- Docs: add torch compile cache (#4151) · ebddb65a
  Chayenne authored Mar 06, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ebddb65a
- Docs: improve EAGLE docs (#4038) · 8f0b6313
  simveit authored Mar 06, 2025
  
  8f0b6313
- fix cross-reference error and spelling mistakes (#4101) · d2d0d061
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  d2d0d061
05 Mar, 2025 5 commits
- Add examples for server token-in-token-out (#4103) · 357671e2
  Qiaolin Yu authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  357671e2
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
03 Mar, 2025 7 commits
- Add examples in sampling parameters (#4039) · 146ac8df
  Chayenne authored Mar 03, 2025
  
  146ac8df
- Docs: Fix sampling parameter (#4034) · 2796fbb5
  Chayenne authored Mar 03, 2025
  
  2796fbb5
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
- Add examples to token-in-token-out for LLM (#4010) · 728e175f
  Chayenne authored Mar 02, 2025
  
  728e175f
- Revert "Add fast decode plan for flashinfer mla" (#4008) · 9e1014cf
  Lianmin Zheng authored Mar 02, 2025
  
  9e1014cf
- Add fast decode plan for flashinfer mla (#3987) · fa561067
  Baizhou Zhang authored Mar 02, 2025
  
  fa561067