Commits · 3a08f54638401f5e49cf6e64d1f4ec49eee7a80a · change / sglang

"docs/vscode:/vscode.git/clone" did not exist on "67e34c56d72285f5dfc6b157930e0b3f2888c2c7"

11 Mar, 2025 1 commit
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
09 Mar, 2025 4 commits
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
- [docker] Distributed Serving with k8s Statefulset ( good example for DeepSeek-R1) (#3631) · 0e90ae62
  Peter Pan authored Mar 09, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Kebe <kebe.liu@daocloud.io>
```
  0e90ae62
- docs(reasoning content): 📝 deepseek-r1 parser support qwq (#4124) · 6eec3cdc
  Xihuai Wang authored Mar 09, 2025
  
  6eec3cdc
07 Mar, 2025 5 commits
- [Docs] Improve bullets appearance and grammar (#4174) · c827c671
  Michael Yao authored Mar 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c827c671
- fix int8 doc link (#4179) · b55a621f
  Yineng Zhang authored Mar 07, 2025
  
  b55a621f
- Add an example of using deepseekv3 int8 sglang. (#4177) · ffa1b3e3
  lukec authored Mar 07, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ffa1b3e3
- [Docs] Fix links and grammar issues (#4162) · d557319a
  Michael Yao authored Mar 07, 2025
  
  d557319a
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
06 Mar, 2025 9 commits
- Hot fix small vocal eagle in docs (#4154) · 9854a18a
  Chayenne authored Mar 06, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  9854a18a
- Docs: add torch compile cache (#4151) · ebddb65a
  Chayenne authored Mar 06, 2025
```
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ebddb65a
- [docs] fix HF reference script command (#4148) · 19fd57bc
  Adarsh Shirawalmath authored Mar 07, 2025
  
  19fd57bc
- Release v0.4.3.post4 (#4140) · 9c58e68b
  Lianmin Zheng authored Mar 06, 2025
  
  9c58e68b
- Docs: improve EAGLE docs (#4038) · 8f0b6313
  simveit authored Mar 06, 2025
  
  8f0b6313
- feat: support docs auto live-reload with sphinx-autobuild (#4111) · b9b3b098
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  b9b3b098
- chore: bump v0.4.3.post3 (#4114) · fc671f66
  Yineng Zhang authored Mar 05, 2025
  
  fc671f66
- fix Non-consecutive header level increase in docs/router/router.md (#4099) · 197751e9
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  197751e9
- fix cross-reference error and spelling mistakes (#4101) · d2d0d061
  samzong authored Mar 06, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  d2d0d061
05 Mar, 2025 8 commits
- revert deepseek docs (#4109) · 0aaccbbf
  Yineng Zhang authored Mar 05, 2025
  
  0aaccbbf
- Add examples for server token-in-token-out (#4103) · 357671e2
  Qiaolin Yu authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  357671e2
- Docs: reorganize dpsk docs (#4108) · e70fa279
  Chayenne authored Mar 05, 2025
  
  e70fa279
- Docs: Add DeepSeek optimization ablations documentation (#4107) · abe74b7b
  Tommy Yang authored Mar 06, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  abe74b7b
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
03 Mar, 2025 9 commits
- Add examples in sampling parameters (#4039) · 146ac8df
  Chayenne authored Mar 03, 2025
  
  146ac8df
- Docs: Fix sampling parameter (#4034) · 2796fbb5
  Chayenne authored Mar 03, 2025
  
  2796fbb5
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Update metrics documentation (#3264) · a7000a76
  Yudi Xue authored Mar 03, 2025
  
  a7000a76
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
- Add examples to token-in-token-out for LLM (#4010) · 728e175f
  Chayenne authored Mar 02, 2025
  
  728e175f
- Revert "Add fast decode plan for flashinfer mla" (#4008) · 9e1014cf
  Lianmin Zheng authored Mar 02, 2025
  
  9e1014cf
- Add fast decode plan for flashinfer mla (#3987) · fa561067
  Baizhou Zhang authored Mar 02, 2025
  
  fa561067
- [feat] add small vocab table for eagle's draft model[1]. (#3822) · 7fbab730
  Zhousx authored Mar 03, 2025
```
Co-authored-by: Achazwl <323163497@qq.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7fbab730
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
01 Mar, 2025 2 commits
- Docs: add special warning to engine docs (#3979) · 6b859e7d
  Chayenne authored Feb 28, 2025
  
  6b859e7d
- Docs: Add redline to highlight main process (#3977) · 3f8a4414
  Chayenne authored Feb 28, 2025
  
  3f8a4414