Commits · 7d5d1d3d2915d386d20890d5bda466834fc220be · change / sglang

30 Nov, 2024 1 commit
- udate weights from disk (#2265) · 7d5d1d3d
  Chayenne authored Nov 29, 2024
  
  7d5d1d3d
29 Nov, 2024 1 commit
- Simplify tokenizer manager (#2254) · fe97a2d4
  Lianmin Zheng authored Nov 29, 2024
  
  fe97a2d4
26 Nov, 2024 1 commit
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
25 Nov, 2024 1 commit
- [feat] Refactor session control interface and add CI (#2173) · e1e595d7
  Ying Sheng authored Nov 25, 2024
  
  e1e595d7
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
20 Nov, 2024 1 commit
- [feat] Add session control (#2073) · 5942dfc0
  Ying Sheng authored Nov 20, 2024
  
  5942dfc0
12 Nov, 2024 1 commit
- Fix a typo in io_struct.py (#2008) · befc6beb
  Lianmin Zheng authored Nov 11, 2024
  
  befc6beb
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
03 Nov, 2024 3 commits
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
- Simplify tokenizer manager (#1904) · c17c5781
  Lianmin Zheng authored Nov 03, 2024
  
  c17c5781
- Simplify tokenizer manager (#1899) · 838dcda1
  Lianmin Zheng authored Nov 03, 2024
  
  838dcda1
26 Oct, 2024 1 commit
- [Fix] Fix --skip-tokenizer-init (#1798) · fb99aaa5
  Lianmin Zheng authored Oct 25, 2024
  
  fb99aaa5
23 Oct, 2024 1 commit
- [API] add get memory pool size (#1760) · 2fce449b
  Ying Sheng authored Oct 23, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  2fce449b
17 Oct, 2024 1 commit
- Fix failed ci tests on long prompts; Better error messages for embedding models (#1700) · 7feba415
  Lianmin Zheng authored Oct 17, 2024
  
  7feba415
14 Oct, 2024 1 commit
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
13 Oct, 2024 1 commit
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
11 Oct, 2024 2 commits
- Add the ability to enable and disable the Profiler via HTTP API. (#1626) · bbd72bfc
  科英 authored Oct 11, 2024
  
  bbd72bfc
- [Bug] Fix the Image Input of Batch Generation (#1579) · b503881b
  Yiding-Lu authored Oct 11, 2024
  
  b503881b
06 Oct, 2024 1 commit
- Fix runtime.generate when sampling param is not passed (#1582) · 521f862d
  Byron Hsu authored Oct 05, 2024
  
  521f862d
01 Oct, 2024 1 commit
- [Refactor] Simplify io_struct and tokenizer_manager (#1549) · f202ed97
  Ying Sheng authored Oct 01, 2024
  
  f202ed97
30 Sep, 2024 1 commit
- Move scheduler code from tp_worker.py to scheduler.py (#1538) · f86c1e61
  Lianmin Zheng authored Sep 29, 2024
  
  f86c1e61
29 Sep, 2024 1 commit
- Organize image inputs (#1531) · fd9ad817
  Liangsheng Yin authored Sep 28, 2024
  
  fd9ad817
28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
18 Sep, 2024 1 commit
- Fixed n>1 causing list index out of range with VLM (#1449) · 5752f25e
  Xiao Yu authored Sep 18, 2024
  
  5752f25e
15 Sep, 2024 1 commit
- [Fix] Fix logprob and normalized_logprob (#1428) · 9ba1f097
  Lianmin Zheng authored Sep 15, 2024
  
  9ba1f097
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
10 Sep, 2024 1 commit
- [Fix] fix bug of `undefined is_single` in meth `create_abort_task` (#1370) · fec2d122
  wangchao authored Sep 10, 2024
  
  fec2d122
09 Sep, 2024 1 commit
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
29 Aug, 2024 1 commit
- fix data racing due to mutable reference using deepcopy (#1255) · 8153168c
  Zhiqiang Xie authored Aug 28, 2024
  
  8153168c
28 Aug, 2024 1 commit
- [Fix] Fix llava on multi images (#1247) · bf53bf51
  Lianmin Zheng authored Aug 28, 2024
  
  bf53bf51
21 Aug, 2024 1 commit
- Improve code style of sampler (#1168) · 83e23c69
  Liangsheng Yin authored Aug 21, 2024
  
  83e23c69
20 Aug, 2024 1 commit
- [Feat] Support update weights without restart server (#1157) · cd10654e
  Shan Yu authored Aug 20, 2024
  
  cd10654e
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

17 Aug, 2024 1 commit
- Improve the code style: more comments and remove useless packages (#1139) · cdc8d607
  Lianmin Zheng authored Aug 17, 2024
  
  cdc8d607
10 Aug, 2024 1 commit
- fix: force max new tokens to be 1 for embedding request (#1019) · b68c4c07
  Ying Sheng authored Aug 10, 2024
  
  b68c4c07
09 Aug, 2024 1 commit
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
08 Aug, 2024 1 commit
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
04 Aug, 2024 1 commit
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d