Commits · 14344caa38e056ae569dce3b1aaefec712b16f2a · change / sglang

05 Mar, 2025 1 commit
- Add examples for returning hidden states when using the server (#4074) · 4725e3f6
  Qiaolin Yu authored Mar 04, 2025
  
  4725e3f6
03 Mar, 2025 3 commits
- Add examples in sampling parameters (#4039) · 146ac8df
  Chayenne authored Mar 03, 2025
  
  146ac8df
- Docs: Fix sampling parameter (#4034) · 2796fbb5
  Chayenne authored Mar 03, 2025
  
  2796fbb5
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
02 Mar, 2025 1 commit
- Refactor: Move return_hidden_states to the generate input (#3985) · 40782f05
  Qiaolin Yu authored Mar 01, 2025
```
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
```
  40782f05
01 Mar, 2025 1 commit
- Docs: add type hint to smapling parameters (#3975) · aceb4201
  Chayenne authored Feb 28, 2025
  
  aceb4201
27 Feb, 2025 1 commit

Add return hidden state in the native API (#3897) · d6898dd2

Qiaolin Yu authored Feb 27, 2025


Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

d6898dd2

19 Feb, 2025 1 commit
- Docs: Fix layout with sub-section (#3710) · 3c7bfd7e
  Chayenne authored Feb 19, 2025
  
  3c7bfd7e
17 Feb, 2025 1 commit
- [docs] Update sampling_params.md (#3617) · d03c4c25
  Shi Shuai authored Feb 17, 2025
  
  d03c4c25
16 Feb, 2025 1 commit
- Draft of updated doc for sampling params. (#3260) · 8f13377d
  simveit authored Feb 16, 2025
```
Co-authored-by: shuaills <shishuaicareer@gmail.com>
```
  8f13377d
21 Jan, 2025 1 commit
- [Doc] Update doc of custom logit processor (#3021) · 949b3fbf
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  949b3fbf
19 Jan, 2025 1 commit
- support regex in xgrammar backend (#2983) · 3bcf5ece
  Enrique Shockwave authored Jan 19, 2025
  
  3bcf5ece
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
29 Dec, 2024 1 commit
- [Docs] Add EBNF to sampling params docs (#2609) · fd34f2da
  Adarsh Shirawalmath authored Dec 29, 2024
  
  fd34f2da
26 Dec, 2024 1 commit

Fix logprob_start_len for multi modal models (#2597) · 77395154

Lianmin Zheng authored Dec 26, 2024


Co-authored-by: libra <lihu723@gmail.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Wang, Haoyu <haoyu.wang@intel.com>

77395154

26 Nov, 2024 1 commit
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
03 Nov, 2024 1 commit
- Fix regex docs (#1909) · 1853c352
  Lianmin Zheng authored Nov 03, 2024
  
  1853c352
02 Nov, 2024 3 commits
- Fix docs (#1889) · 7b394e5f
  Lianmin Zheng authored Nov 02, 2024
  
  7b394e5f
- Fix links in the docs (#1878) · 2134f089
  Lianmin Zheng authored Nov 01, 2024
  
  2134f089
- Improve docs and fix the broken links (#1875) · d1b31b06
  Lianmin Zheng authored Nov 01, 2024
  
  d1b31b06
01 Nov, 2024 1 commit
- change file tree (#1859) · 61cf00e1
  Chayenne authored Oct 31, 2024
```
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
```
  61cf00e1
26 Oct, 2024 1 commit
- Update ci workflows (#1804) · 6aa94b96
  Lianmin Zheng authored Oct 26, 2024
  
  6aa94b96
18 Sep, 2024 1 commit
- Fuse top_k and top_k in the sampler (#1457) · 7f24ea95
  Lianmin Zheng authored Sep 18, 2024
  
  7f24ea95
26 Aug, 2024 1 commit
- [FEAT] JSON constrained support (#1125) · 9935f97b
  havetc authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9935f97b
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
21 Aug, 2024 1 commit
- Support min-p sampling (#1167) · 068e9eae
  intervitens authored Aug 22, 2024
  
  068e9eae
08 Aug, 2024 2 commits
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- #590 Increase default , track changes in examples and documentation (#971) · c62d560c
  foszto authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  c62d560c
28 Jul, 2024 2 commits
- docs: init readthedocs support (#783) · 94862579
  Yineng Zhang authored Jul 28, 2024
  
  94862579
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
20 Jul, 2024 1 commit
- Fix illegal tokens during sampling (#676) · f424e76d
  Liangsheng Yin authored Jul 20, 2024
  
  f424e76d
19 Jul, 2024 3 commits
- Update docs · 50a53887
  Ying Sheng authored Jul 19, 2024
  
  50a53887
- Improve docs (#662) · e87c7fd5
  Ying Sheng authored Jul 19, 2024
  
  e87c7fd5
- Update Readme (#660) · 51fda143
  Ying Sheng authored Jul 19, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  51fda143
12 May, 2024 1 commit
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
31 Jan, 2024 1 commit
- Update sampling_params.md · 876db8dc
  Lianmin Zheng authored Jan 31, 2024
  
  876db8dc
30 Jan, 2024 1 commit
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0