Commits · fb1f28cbbbd3e2abcbf40dc043e5b2556938abec · change / sglang

12 Aug, 2024 2 commits
- Delete the useless test/srt/test_throughput.py (#1045) · 14b64930
  Lianmin Zheng authored Aug 11, 2024
  
  14b64930
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
11 Aug, 2024 1 commit
- Test the case when max_new_tokens is very large (#1038) · d84c5e70
  Lianmin Zheng authored Aug 11, 2024
  
  d84c5e70
10 Aug, 2024 3 commits
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
- fix: force max new tokens to be 1 for embedding request (#1019) · b68c4c07
  Ying Sheng authored Aug 10, 2024
  
  b68c4c07
- Support embedding input as a list (#1014) · 7599bade
  Ying Sheng authored Aug 10, 2024
  
  7599bade
09 Aug, 2024 5 commits
- Add skip_tokenizer_init args. (#959) · 9cf0a5ba
  gryffindor-rr authored Aug 10, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  9cf0a5ba
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
- bugfix: penalizers to be merged before reqs (#1001) · 10bca45b
  Juwan Yoo authored Aug 09, 2024
  
  10bca45b
- support models from www.modelscope.cn (#994) · b91a4cb1
  liuyhwangyh authored Aug 09, 2024
```
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
```
  b91a4cb1
- test: negative value testing for frequency, presence penalizers (#995) · 95a28019
  Juwan Yoo authored Aug 08, 2024
  
  95a28019
08 Aug, 2024 3 commits
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
07 Aug, 2024 3 commits
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
- misc: simplify test (#964) · 5f6fa04a
  yichuan~ authored Aug 07, 2024
  
  5f6fa04a
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
05 Aug, 2024 3 commits
- Fix prompt len in parallel sampling (#928) · fd7926e4
  yichuan~ authored Aug 05, 2024
  
  fd7926e4
- Test regex in vision api (#926) · 0a4f5f9b
  Ying Sheng authored Aug 04, 2024
  
  0a4f5f9b
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 5 commits
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
- Add model accuracy test - step 1 (#866) · 70cc0749
  Ying Sheng authored Aug 03, 2024
  
  70cc0749
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
01 Aug, 2024 2 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
28 Jul, 2024 1 commit
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
19 Jul, 2024 1 commit
- Update Readme (#660) · 51fda143
  Ying Sheng authored Jul 19, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  51fda143
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
25 Jun, 2024 1 commit
- Add sglang.bench_latency for offline benchmark (#564) · eb1ae6ae
  Lianmin Zheng authored Jun 25, 2024
  
  eb1ae6ae
24 Jun, 2024 1 commit
- Update test_flashinfer (#560) · 05471f21
  Liangsheng Yin authored Jun 24, 2024
  
  05471f21
22 Jun, 2024 1 commit
- Add LlamaForClassification (#559) · 1fa15099
  Lianmin Zheng authored Jun 22, 2024
  
  1fa15099
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
12 May, 2024 2 commits
- Misc fixes (#432) · 6e09cf6a
  Lianmin Zheng authored May 12, 2024
  
  6e09cf6a
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
25 Apr, 2024 1 commit
- Minor: style improvement of radix_cache and memory_pool (#395) · 19818b9c
  Liangsheng Yin authored Apr 26, 2024
  
  19818b9c
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020