Commits · 4013a4e1b0a1210c0cfa729bd68130fc96030d50 · change / sglang

"aten/cpu/loop.cpp" did not exist on "c8338385c5084957a4d55f27e469551d3125457f"

02 Aug, 2024 1 commit
- Implement served_model_name to customize model id when use local mode… (#749) · 4013a4e1
  任嘉 authored Aug 02, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  4013a4e1
01 Aug, 2024 17 commits
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
- Update runner docs (#876) · 70c78cfb
  Liangsheng Yin authored Aug 01, 2024
  
  70c78cfb
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- bump to 0.2.8 (#877) · e4d3333c
  Ying Sheng authored Aug 01, 2024
  
  e4d3333c
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- misc: update unit test config (#873) · aba6f51f
  Yineng Zhang authored Aug 02, 2024
  
  aba6f51f
- misc: use pip cache purge and add unit test ci (#871) · 7f6c690b
  Yineng Zhang authored Aug 02, 2024
  
  7f6c690b
- Fix openai CI tests (#870) · 40e6f513
  Ying Sheng authored Aug 01, 2024
  
  40e6f513
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
- misc: add cancel previous at e2e (#864) · 9e8d2c7f
  Yineng Zhang authored Aug 01, 2024
  
  9e8d2c7f
- misc: disable auto release (#862) · c9bff5fc
  Yineng Zhang authored Aug 01, 2024
  
  c9bff5fc
- Rename github workflows (#861) · b04444ac
  Ying Sheng authored Aug 01, 2024
  
  b04444ac
- misc: update e2e test paths config (#860) · 3d617a21
  Yineng Zhang authored Aug 01, 2024
  
  3d617a21
- Support chunked prefill when radix cache is disabled (#811) · c020f9ce
  Liangsheng Yin authored Aug 01, 2024
  
  c020f9ce
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c
- Fix #857 (#858) · 0c0c8137
  Kai Fronsdal authored Aug 01, 2024
  
  0c0c8137
- Add troubleshooting doc (#856) · 90286d85
  Ying Sheng authored Aug 01, 2024
  
  90286d85
31 Jul, 2024 5 commits
- Fix llama for classification (#855) · 5e7dd984
  Ying Sheng authored Jul 31, 2024
  
  5e7dd984
- chore: update flashinfer to v0.1.3 (#850) · bc3eaac2
  Yineng Zhang authored Aug 01, 2024
  
  bc3eaac2
- misc: update e2e test paths config (#848) · a78d98de
  Yineng Zhang authored Jul 31, 2024
  
  a78d98de
- docs: update README.md (#843) · 7d5ed7c6
  Ikko Eltociear Ashimine authored Jul 31, 2024
  
  7d5ed7c6
- Add req slots leaking check (#842) · a6c7ebbb
  Liangsheng Yin authored Jul 30, 2024
  
  a6c7ebbb
30 Jul, 2024 17 commits
- Fix List input bug (#838) · bb0501c0
  yichuan~ authored Jul 31, 2024
  
  bb0501c0
- Add `--max-total-tokens` (#840) · 6b0f2e90
  Liangsheng Yin authored Jul 30, 2024
  
  6b0f2e90
- chore: bump v0.2.7 (#830) · 1edd4e07
  Yineng Zhang authored Jul 30, 2024
  
  1edd4e07
- docs: add set up runner (#829) · 62c673c4
  Yineng Zhang authored Jul 30, 2024
  
  62c673c4
- misc: enable e2e test when push (#828) · 377c5dc9
  Yineng Zhang authored Jul 30, 2024
  
  377c5dc9
- misc: update e2e test benchmark config (#825) · f52eda35
  Yineng Zhang authored Jul 30, 2024
  
  f52eda35
- Add awq_marlin (#826) · b579ecf0
  Ying Sheng authored Jul 30, 2024
  
  b579ecf0
- Adjust default mem fraction to avoid OOM (#823) · e7487b08
  Ying Sheng authored Jul 30, 2024
  
  e7487b08
- Support disable_ignore_eos in bench_serving.py (#824) · ae5c0fc4
  Ying Sheng authored Jul 30, 2024
  
  ae5c0fc4
- feat: add pr e2e test (#822) · a30d5d75
  Yineng Zhang authored Jul 30, 2024
  
  a30d5d75
- feat: add runner (#821) · 17af39c5
  Yineng Zhang authored Jul 30, 2024
  
  17af39c5
- Fix streaming bug (#820) · daf593a3
  ObjectNotFound authored Jul 30, 2024
  
  daf593a3
- docs: update README (#819) · bece265f
  Yineng Zhang authored Jul 30, 2024
  
  bece265f
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
- Fix LiteLLM kwargs (#817) · 21e22b9e
  Enrique Shockwave authored Jul 30, 2024
  
  21e22b9e
- fix: use v0.2.5 for benchmark (#814) · a50c8a14
  Yineng Zhang authored Jul 30, 2024
  
  a50c8a14
- Revert "Organize public APIs" (#815) · db6089e6
  Ying Sheng authored Jul 29, 2024
  
  db6089e6