Commits · 357671e216d30e8e11afd4210624a71c11c12329 · change / sglang

"include/ck/utility/functional2.hpp" did not exist on "1566b31736d191fe3a43dd5efa59968e44191729"

05 Mar, 2025 7 commits
- Add examples for server token-in-token-out (#4103) · 357671e2
  Qiaolin Yu authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  357671e2
- Docs: reorganize dpsk docs (#4108) · e70fa279
  Chayenne authored Mar 05, 2025
  
  e70fa279
- Docs: Add DeepSeek optimization ablations documentation (#4107) · abe74b7b
  Tommy Yang authored Mar 06, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  abe74b7b
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
- example: add vlm to token in & out example (#3941) · 583d6af7
  Mick authored Mar 05, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  583d6af7
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
04 Mar, 2025 1 commit
- Reasoning parser (#4000) · 95575aa7
  Xihuai Wang authored Mar 04, 2025
```
Co-authored-by: Lucas Pickup <lupickup@microsoft.com>
```
  95575aa7
03 Mar, 2025 9 commits
- Add examples in sampling parameters (#4039) · 146ac8df
  Chayenne authored Mar 03, 2025
  
  146ac8df
- Docs: Fix sampling parameter (#4034) · 2796fbb5
  Chayenne authored Mar 03, 2025
  
  2796fbb5
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Update metrics documentation (#3264) · a7000a76
  Yudi Xue authored Mar 03, 2025
  
  a7000a76
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
- Add examples to token-in-token-out for LLM (#4010) · 728e175f
  Chayenne authored Mar 02, 2025
  
  728e175f
- Revert "Add fast decode plan for flashinfer mla" (#4008) · 9e1014cf
  Lianmin Zheng authored Mar 02, 2025
  
  9e1014cf
- Add fast decode plan for flashinfer mla (#3987) · fa561067
  Baizhou Zhang authored Mar 02, 2025
  
  fa561067
- [feat] add small vocab table for eagle's draft model[1]. (#3822) · 7fbab730
  Zhousx authored Mar 03, 2025
```
Co-authored-by: Achazwl <323163497@qq.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  7fbab730
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
01 Mar, 2025 4 commits
- Docs: add special warning to engine docs (#3979) · 6b859e7d
  Chayenne authored Feb 28, 2025
  
  6b859e7d
- Docs: Add redline to highlight main process (#3977) · 3f8a4414
  Chayenne authored Feb 28, 2025
  
  3f8a4414
- Docs: add type hint to smapling parameters (#3975) · aceb4201
  Chayenne authored Feb 28, 2025
  
  aceb4201
- [Feature]Support ragged prefill in flashinfer mla backend (#3967) · 90a4b7d9
  Baizhou Zhang authored Feb 28, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  90a4b7d9
27 Feb, 2025 6 commits
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
- revert "Docs: Reorngaize dpsk links #3900" (#3933) · 5d860168
  Yineng Zhang authored Feb 27, 2025
  
  5d860168
- [Doc] Add experimental tag for flashinfer mla (#3925) · 3e02526b
  Baizhou Zhang authored Feb 27, 2025
  
  3e02526b
- [Docs] Improve DPSK docs in dark mode (#3914) · d8a98a2c
  Stefan He authored Feb 27, 2025
  
  d8a98a2c
- Add return hidden state in the native API (#3897) · d6898dd2
  Qiaolin Yu authored Feb 27, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  d6898dd2
- [doc] Update document for flashinfer mla (#3907) · 71ed0183
  Baizhou Zhang authored Feb 26, 2025
  
  71ed0183
26 Feb, 2025 7 commits
- Docs: Implemented frontend docs (#3791) · acd1a159
  simveit authored Feb 27, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  acd1a159
- Docs: Reorngaize dpsk links (#3900) · 7c1692aa
  Chayenne authored Feb 26, 2025
  
  7c1692aa
- Docs: Move dpsk docs forward a step (#3894) · 8f019c7d
  Chayenne authored Feb 26, 2025
  
  8f019c7d
- [Feature] Support llguidance for constrained decoding (#3298) · 7551498a
  JC1DA authored Feb 26, 2025
  
  7551498a
- Docs: improve link to docs (#3860) · 44a2c4bd
  simveit authored Feb 26, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  44a2c4bd
- Docs: delete sgl-kernel install in docs (#3845) · c9fc4a9d
  simveit authored Feb 26, 2025
  
  c9fc4a9d
- [doc] fixed dpsk quant faq (#3865) · 3dc9ff3c
  Shenggui Li authored Feb 26, 2025
  
  3dc9ff3c
25 Feb, 2025 5 commits
- [doc] added quantization doc for dpsk (#3843) · 06427dfa
  Shenggui Li authored Feb 26, 2025
  
  06427dfa
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
- [Doc] Fix typo in server-argument description (#3641) · 3758d209
  Yuanheng Zhao authored Feb 25, 2025
  
  3758d209
- Docs: fix doc site copyright to current year (#3741) · faf29e0b
  Wilson Wu authored Feb 25, 2025
  
  faf29e0b
- Docs: fix dead link in router.md (#3799) · b0743ea0
  He1pa authored Feb 25, 2025
  
  b0743ea0