Commits · 70cc0749ce0d8a6fa28323c057311ebe88a6157e · zhaoyu6 / sglang

"host/driver_offline/src/gemm_driver_offline.cpp" did not exist on "627d8ef35a6da8ad268b5197e3045ccdfb4ac684"

04 Aug, 2024 2 commits
- Add model accuracy test - step 1 (#866) · 70cc0749
  Ying Sheng authored Aug 03, 2024
  
  70cc0749
- fixed an error handling in bench_latency.py (#904) · 7dd8a7e6
  min-xu-et authored Aug 03, 2024
  
  7dd8a7e6
02 Aug, 2024 9 commits
- Bump version to 0.2.9.post1 (#899) · b906c015
  Ying Sheng authored Aug 02, 2024
  
  b906c015
- chore: add multipart dep for fastapi (#895) · 046c2b33
  Yineng Zhang authored Aug 02, 2024
  
  046c2b33
- misc: update cuda graph capture exception log (#894) · 6b8f66ef
  Yineng Zhang authored Aug 02, 2024
  
  6b8f66ef
- Bump version to v0.2.9 (#890) · 30a9b2ef
  Ying Sheng authored Aug 02, 2024
  
  30a9b2ef
- Increase openai client limit (#886) · 3cadecf0
  Ying Sheng authored Aug 02, 2024
  
  3cadecf0
- Add benchmark: HumanEval (#889) · e90e3a50
  Ying Sheng authored Aug 02, 2024
  
  e90e3a50
- Fix the double BOS problem in the HF chat template (#888) · fbd6b94d
  Ying Sheng authored Aug 02, 2024
  
  fbd6b94d
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
- Implement served_model_name to customize model id when use local mode… (#749) · 4013a4e1
  任嘉 authored Aug 02, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  4013a4e1
01 Aug, 2024 8 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- bump to 0.2.8 (#877) · e4d3333c
  Ying Sheng authored Aug 01, 2024
  
  e4d3333c
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- misc: use pip cache purge and add unit test ci (#871) · 7f6c690b
  Yineng Zhang authored Aug 02, 2024
  
  7f6c690b
- Support chunked prefill when radix cache is disabled (#811) · c020f9ce
  Liangsheng Yin authored Aug 01, 2024
  
  c020f9ce
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c
- Fix #857 (#858) · 0c0c8137
  Kai Fronsdal authored Aug 01, 2024
  
  0c0c8137
31 Jul, 2024 3 commits
- Fix llama for classification (#855) · 5e7dd984
  Ying Sheng authored Jul 31, 2024
  
  5e7dd984
- chore: update flashinfer to v0.1.3 (#850) · bc3eaac2
  Yineng Zhang authored Aug 01, 2024
  
  bc3eaac2
- Add req slots leaking check (#842) · a6c7ebbb
  Liangsheng Yin authored Jul 30, 2024
  
  a6c7ebbb
30 Jul, 2024 12 commits
- Fix List input bug (#838) · bb0501c0
  yichuan~ authored Jul 31, 2024
  
  bb0501c0
- Add `--max-total-tokens` (#840) · 6b0f2e90
  Liangsheng Yin authored Jul 30, 2024
  
  6b0f2e90
- chore: bump v0.2.7 (#830) · 1edd4e07
  Yineng Zhang authored Jul 30, 2024
  
  1edd4e07
- misc: update e2e test benchmark config (#825) · f52eda35
  Yineng Zhang authored Jul 30, 2024
  
  f52eda35
- Add awq_marlin (#826) · b579ecf0
  Ying Sheng authored Jul 30, 2024
  
  b579ecf0
- Adjust default mem fraction to avoid OOM (#823) · e7487b08
  Ying Sheng authored Jul 30, 2024
  
  e7487b08
- Support disable_ignore_eos in bench_serving.py (#824) · ae5c0fc4
  Ying Sheng authored Jul 30, 2024
  
  ae5c0fc4
- Fix streaming bug (#820) · daf593a3
  ObjectNotFound authored Jul 30, 2024
  
  daf593a3
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
- Fix LiteLLM kwargs (#817) · 21e22b9e
  Enrique Shockwave authored Jul 30, 2024
  
  21e22b9e
- Revert "Organize public APIs" (#815) · db6089e6
  Ying Sheng authored Jul 29, 2024
  
  db6089e6
- Remove inf value for chunked prefill size (#812) · 3520f75f
  Liangsheng Yin authored Jul 29, 2024
  
  3520f75f
29 Jul, 2024 6 commits
- Organize public APIs (#809) · c8e9fed8
  Liangsheng Yin authored Jul 29, 2024
  
  c8e9fed8
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
- Revert "Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118"" (#806) · eba458bd
  Ying Sheng authored Jul 29, 2024
  
  eba458bd
- feat: add chat template for internlm2-chat (#802) · 3d1cb0af
  Yineng Zhang authored Jul 30, 2024
  
  3d1cb0af
- Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118" (#805) · 7d352b4f
  Ying Sheng authored Jul 29, 2024
  
  7d352b4f
- fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803) · 87064015
  Yineng Zhang authored Jul 30, 2024
  
  87064015