Commits · c31f084c713cb91f0fdb54306f0851aa2780fdf5 · change / sglang · GitLab

07 Aug, 2024 7 commits
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
- misc: fix the req_to_token member change (#967) · a01ddd96
  Liangsheng Yin authored Aug 07, 2024
  
  a01ddd96
- Make `req_pool_indices` on CPU (#960) · 7fa54a1a
  Liangsheng Yin authored Aug 07, 2024
  
  7fa54a1a
- misc: add compute capability in check_env (#965) · 05abd126
  Yineng Zhang authored Aug 07, 2024
  
  05abd126
- Show more error messages for warmup errors (#932) · ff68ae85
  Ying Sheng authored Aug 06, 2024
  
  ff68ae85
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
06 Aug, 2024 1 commit
- Fix stuck in `get_new_prefill_batch` (#948) · ad56e684
  Liangsheng Yin authored Aug 06, 2024
  
  ad56e684
05 Aug, 2024 7 commits
- Support multiple args options (#941) · ffb15744
  yichuan~ authored Aug 06, 2024
  
  ffb15744
- Fix union operator (#940) · a9c833d5
  Ke Bao authored Aug 06, 2024
  
  a9c833d5
- Feat: add alternative choices selection methods (#835) · 94e01151
  Aidan Cooper authored Aug 05, 2024
  
  94e01151
- Remove leftover auth_token (#934) · b216a545
  Aidan Cooper authored Aug 05, 2024
  
  b216a545
- Fix prompt len in parallel sampling (#928) · fd7926e4
  yichuan~ authored Aug 05, 2024
  
  fd7926e4
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
- latency test enhancement - final part (#921) · ebf69964
  min-xu-et authored Aug 04, 2024
  
  ebf69964
04 Aug, 2024 11 commits
- Bump version to 0.2.10 (#923) · 141e8c71
  Ying Sheng authored Aug 04, 2024
  
  141e8c71
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
- enhance latency test - part 2 (#915) · afd411d0
  min-xu-et authored Aug 04, 2024
  
  afd411d0
- Support MLA for DeepSeek-V2 with Triton - step 1 (#905) · e1eae1fd
  Ke Bao authored Aug 05, 2024
  
  e1eae1fd
- misc: add triton in check_env PACKAGE_LIST (#914) · f4d9953d
  Yineng Zhang authored Aug 04, 2024
  
  f4d9953d
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
- latency test enhancement - part 1 (#909) · 53985645
  min-xu-et authored Aug 03, 2024
  
  53985645
- Add model accuracy test - step 1 (#866) · 70cc0749
  Ying Sheng authored Aug 03, 2024
  
  70cc0749
- fixed an error handling in bench_latency.py (#904) · 7dd8a7e6
  min-xu-et authored Aug 03, 2024
  
  7dd8a7e6
02 Aug, 2024 9 commits
- Bump version to 0.2.9.post1 (#899) · b906c015
  Ying Sheng authored Aug 02, 2024
  
  b906c015
- chore: add multipart dep for fastapi (#895) · 046c2b33
  Yineng Zhang authored Aug 02, 2024
  
  046c2b33
- misc: update cuda graph capture exception log (#894) · 6b8f66ef
  Yineng Zhang authored Aug 02, 2024
  
  6b8f66ef
- Bump version to v0.2.9 (#890) · 30a9b2ef
  Ying Sheng authored Aug 02, 2024
  
  30a9b2ef
- Increase openai client limit (#886) · 3cadecf0
  Ying Sheng authored Aug 02, 2024
  
  3cadecf0
- Add benchmark: HumanEval (#889) · e90e3a50
  Ying Sheng authored Aug 02, 2024
  
  e90e3a50
- Fix the double BOS problem in the HF chat template (#888) · fbd6b94d
  Ying Sheng authored Aug 02, 2024
  
  fbd6b94d
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
- Implement served_model_name to customize model id when use local mode… (#749) · 4013a4e1
  任嘉 authored Aug 02, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  4013a4e1
01 Aug, 2024 5 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- bump to 0.2.8 (#877) · e4d3333c
  Ying Sheng authored Aug 01, 2024
  
  e4d3333c
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- misc: use pip cache purge and add unit test ci (#871) · 7f6c690b
  Yineng Zhang authored Aug 02, 2024
  
  7f6c690b