Commits · e1eae1fd15ed8e125ddcd18d0193ae8529c0c309 · change / sglang · GitLab

04 Aug, 2024 7 commits
- Support MLA for DeepSeek-V2 with Triton - step 1 (#905) · e1eae1fd
  Ke Bao authored Aug 05, 2024
  
  e1eae1fd
- misc: add triton in check_env PACKAGE_LIST (#914) · f4d9953d
  Yineng Zhang authored Aug 04, 2024
  
  f4d9953d
- fix: use e2e and unit test only for original repo or pr (#912) · 4f005250
  Yineng Zhang authored Aug 04, 2024
  
  4f005250
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
- latency test enhancement - part 1 (#909) · 53985645
  min-xu-et authored Aug 03, 2024
  
  53985645
- Add model accuracy test - step 1 (#866) · 70cc0749
  Ying Sheng authored Aug 03, 2024
  
  70cc0749
- fixed an error handling in bench_latency.py (#904) · 7dd8a7e6
  min-xu-et authored Aug 03, 2024
  
  7dd8a7e6
03 Aug, 2024 3 commits
- Reorder CI unit tests. (#908) · 947402c8
  Liangsheng Yin authored Aug 03, 2024
  
  947402c8
- Update README.md · 8c5382e6
  Ying Sheng authored Aug 03, 2024
  
  8c5382e6
- Update the base image of the docker (#900) · 001b0bdd
  Ying Sheng authored Aug 02, 2024
  
  001b0bdd
02 Aug, 2024 15 commits
- Bump version to 0.2.9.post1 (#899) · b906c015
  Ying Sheng authored Aug 02, 2024
  
  b906c015
- [minor] fixed code formatting doc (#896) · 9319cd13
  min-xu-et authored Aug 02, 2024
  
  9319cd13
- chore: add multipart dep for fastapi (#895) · 046c2b33
  Yineng Zhang authored Aug 02, 2024
  
  046c2b33
- misc: update cuda graph capture exception log (#894) · 6b8f66ef
  Yineng Zhang authored Aug 02, 2024
  
  6b8f66ef
- docs: update setup runner (#884) · 7937a886
  Yineng Zhang authored Aug 02, 2024
  
  7937a886
- fix: set env in runner (#891) · 2e218b9e
  Yineng Zhang authored Aug 02, 2024
  
  2e218b9e
- Bump version to v0.2.9 (#890) · 30a9b2ef
  Ying Sheng authored Aug 02, 2024
  
  30a9b2ef
- Increase openai client limit (#886) · 3cadecf0
  Ying Sheng authored Aug 02, 2024
  
  3cadecf0
- Add benchmark: HumanEval (#889) · e90e3a50
  Ying Sheng authored Aug 02, 2024
  
  e90e3a50
- Fix the double BOS problem in the HF chat template (#888) · fbd6b94d
  Ying Sheng authored Aug 02, 2024
  
  fbd6b94d
- Update workflow name (#883) · 4c8093c8
  Ying Sheng authored Aug 01, 2024
  
  4c8093c8
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
- Add more unit tests to CI (#880) · 76e59088
  Ying Sheng authored Aug 01, 2024
  
  76e59088
- Update runner docs (#879) · 12ce3bef
  Liangsheng Yin authored Aug 01, 2024
  
  12ce3bef
- Implement served_model_name to customize model id when use local mode… (#749) · 4013a4e1
  任嘉 authored Aug 02, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  4013a4e1
01 Aug, 2024 15 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Update runner docs (#876) · 70c78cfb
  Liangsheng Yin authored Aug 01, 2024
  
  70c78cfb
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- bump to 0.2.8 (#877) · e4d3333c
  Ying Sheng authored Aug 01, 2024
  
  e4d3333c
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- misc: update unit test config (#873) · aba6f51f
  Yineng Zhang authored Aug 02, 2024
  
  aba6f51f
- misc: use pip cache purge and add unit test ci (#871) · 7f6c690b
  Yineng Zhang authored Aug 02, 2024
  
  7f6c690b
- Fix openai CI tests (#870) · 40e6f513
  Ying Sheng authored Aug 01, 2024
  
  40e6f513
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
- misc: add cancel previous at e2e (#864) · 9e8d2c7f
  Yineng Zhang authored Aug 01, 2024
  
  9e8d2c7f
- misc: disable auto release (#862) · c9bff5fc
  Yineng Zhang authored Aug 01, 2024
  
  c9bff5fc
- Rename github workflows (#861) · b04444ac
  Ying Sheng authored Aug 01, 2024
  
  b04444ac
- misc: update e2e test paths config (#860) · 3d617a21
  Yineng Zhang authored Aug 01, 2024
  
  3d617a21
- Support chunked prefill when radix cache is disabled (#811) · c020f9ce
  Liangsheng Yin authored Aug 01, 2024
  
  c020f9ce
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c