Commits · 61f42b5732a0740ed9a416a098b96e7e6e14f277 · zhaoyu6 / sglang

20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
11 Dec, 2024 1 commit
- [Core] in batch prefix caching by delay scheduling (#2442) · 9208618b
  SangBin Cho authored Dec 11, 2024
  
  9208618b
24 Nov, 2024 1 commit
- Merged three native APIs into one: get_server_info (#2152) · dbe17293
  Henry Hyeonmok Ko authored Nov 24, 2024
  
  dbe17293
28 Sep, 2024 2 commits
- Multiple minor fixes (#1530) · 4e4459b9
  Lianmin Zheng authored Sep 28, 2024
  
  4e4459b9
- Fix RuntimeEndpoint.select method (#1495) · 065bb947
  Jeffrey Fong authored Sep 29, 2024
  
  065bb947
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
14 Aug, 2024 1 commit
- Use `dtype` to control generate (#1082) · a34dd86a
  Liangsheng Yin authored Aug 14, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a34dd86a
05 Aug, 2024 2 commits
- Feat: add alternative choices selection methods (#835) · 94e01151
  Aidan Cooper authored Aug 05, 2024
  
  94e01151
- Remove leftover auth_token (#934) · b216a545
  Aidan Cooper authored Aug 05, 2024
  
  b216a545
04 Aug, 2024 1 commit
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
28 Jul, 2024 1 commit
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
19 Jul, 2024 1 commit
- Update Readme (#660) · 51fda143
  Ying Sheng authored Jul 19, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  51fda143
14 Jul, 2024 1 commit
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
09 Jul, 2024 1 commit
- [Feat] Expose logprob options to `sgl.gen` API (#503) · 02b72586
  胡译文 authored Jul 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  02b72586
07 Jul, 2024 1 commit
- Fix streaming (#600) · 0877f1e7
  Liangsheng Yin authored Jul 07, 2024
  
  0877f1e7
06 Jul, 2024 2 commits
- * fix(detokenizer_manager.py): fix truncated decoded output (#586) · 26908d95
  uylnap authored Jul 07, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  26908d95
- Fix Llava model (#594) · c0982ac5
  Mingyi authored Jul 06, 2024
  
  c0982ac5
19 May, 2024 1 commit
- openai chat speculative execution (#250) · ec380dfd
  LiviaSun authored May 18, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  ec380dfd
17 May, 2024 1 commit
- Improve error handling & abort disconnected requests (#449) · 8210ec60
  Lianmin Zheng authored May 17, 2024
  
  8210ec60
12 May, 2024 1 commit
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
30 Apr, 2024 1 commit
- SamplingParams add "spaces_between_special_tokens" argument (#392) · 183df472
  ZhouXingg authored May 01, 2024
  
  183df472
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
29 Mar, 2024 1 commit
- Fix llava parallelism/fork bug (#315) · cb389c91
  Junlong Li authored Mar 29, 2024
  
  cb389c91
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
11 Mar, 2024 4 commits
- Fix RuntimeEndpoint (#279) · 13662fd5
  Lianmin Zheng authored Mar 11, 2024
  
  13662fd5
- Add Support for API Key Authentication (#230) · d5ae2eba
  Alessio Dalla Piazza authored Mar 11, 2024
  
  d5ae2eba
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
03 Mar, 2024 1 commit
- Add SSL Cert Functionality (#224) · 01b07ea3
  Srinivas Billa authored Mar 03, 2024
  
  01b07ea3
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
08 Feb, 2024 1 commit
- Add Auth Token to RuntimeEndpoint (#162) · 405f26b0
  Srinivas Billa authored Feb 08, 2024
  
  405f26b0
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
19 Jan, 2024 1 commit
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
15 Jan, 2024 2 commits
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081