Commits · d3efcb3930cfb1c79958dda00ce3e044fd85b714 · change / sglang

20 Aug, 2024 1 commit
- feat: allow streaming for multi-prompt and/or parallel sampling (#1134) · d8476818
  Juwan Yoo authored Aug 20, 2024
  
  d8476818
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
08 Aug, 2024 1 commit
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
07 Aug, 2024 3 commits
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
- misc: simplify test (#964) · 5f6fa04a
  yichuan~ authored Aug 07, 2024
  
  5f6fa04a
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
05 Aug, 2024 3 commits
- Fix prompt len in parallel sampling (#928) · fd7926e4
  yichuan~ authored Aug 05, 2024
  
  fd7926e4
- Test regex in vision api (#926) · 0a4f5f9b
  Ying Sheng authored Aug 04, 2024
  
  0a4f5f9b
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 4 commits
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
01 Aug, 2024 2 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
12 May, 2024 2 commits
- Misc fixes (#432) · 6e09cf6a
  Lianmin Zheng authored May 12, 2024
  
  6e09cf6a
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
11 Feb, 2024 2 commits
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
- Support extra field regex in OpenAI API (#172) · 50afed4e
  Cody Yu authored Feb 10, 2024
  
  50afed4e
06 Feb, 2024 2 commits
- Format code & move functions (#155) · 23f05005
  Lianmin Zheng authored Feb 06, 2024
  
  23f05005
- Support decode token logprobs (#130) · a7334aee
  Cody Yu authored Feb 06, 2024
  
  a7334aee
30 Jan, 2024 1 commit
- [Feature] Adds basic support for image content in OpenAI chat routes (#113) · 1d0fbe8e
  Keith Stevens authored Jan 30, 2024
  
  1d0fbe8e
19 Jan, 2024 2 commits
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939