Commits · 679ebcbbdc37e129b16d305660514dfafda0f7ca · change / sglang

27 Jul, 2024 1 commit
- Deepseek v2 support (#693) · 679ebcbb
  Liangsheng Yin authored Jul 26, 2024
  
  679ebcbb
26 Jul, 2024 13 commits
- fix: use REPO_TOKEN (#755) · 5bd06b45
  Yineng Zhang authored Jul 27, 2024
  
  5bd06b45
- fix: add release tag workflow (#754) · 9a611827
  Yineng Zhang authored Jul 27, 2024
  
  9a611827
- feat: add release tag workflow (#753) · eeb24821
  Yineng Zhang authored Jul 27, 2024
  
  eeb24821
- misc: replace deprecated variable HUGGING_FACE_HUB_TOKEN with HF_TOKEN (#752) · 3e455b01
  Yineng Zhang authored Jul 27, 2024
  
  3e455b01
- feat: add docker workflow (#751) · 8628ab9c
  Yineng Zhang authored Jul 27, 2024
  
  8628ab9c
- chore: bump v0.2.1 (#740) · 1b77670f
  Yineng Zhang authored Jul 26, 2024
  
  1b77670f
- fix benchmark (#743) · 768e05d0
  Yineng Zhang authored Jul 26, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  768e05d0
- docs: fix typo (#742) · 01fbb11b
  Yineng Zhang authored Jul 26, 2024
  
  01fbb11b
- docs: add llama 3.1 405b instruction (#739) · 05d216da
  Yineng Zhang authored Jul 26, 2024
```
Co-authored-by: Ying1123 <sqy1415@gmail.com>
```
  05d216da
- misc: format (#741) · 6b32bb1c
  Yineng Zhang authored Jul 26, 2024
  
  6b32bb1c
- feat: support token ids in /v1/completions (#736) · 40facad5
  Toshiki Kataoka authored Jul 26, 2024
  
  40facad5
- fix /generate without sampling_params (#734) · da504445
  Toshiki Kataoka authored Jul 26, 2024
  
  da504445
- fix: small bug for llama-405b fp16 (#733) · 252e0f7b
  Ying Sheng authored Jul 25, 2024
  
  252e0f7b
25 Jul, 2024 13 commits
- Update readme (#731) · 7f6f2f0f
  Ying Sheng authored Jul 25, 2024
  
  7f6f2f0f
- Update readme · 7802df1e
  Ying Sheng authored Jul 25, 2024
  
  7802df1e
- Bump version to 0.2.0 (#730) · 1a491d00
  Ying Sheng authored Jul 25, 2024
  
  1a491d00
- Fix bugs (fp8 checkpoints, triton cache manager) (#729) · 8fbba3de
  Ying Sheng authored Jul 25, 2024
  
  8fbba3de
- Revert "fix: fp8 config" (#728) · ae0f6130
  Ying Sheng authored Jul 25, 2024
  
  ae0f6130
- misc: update bug issue template (#727) · 60105897
  Yineng Zhang authored Jul 25, 2024
  
  60105897
- fix: resolve the logo display issue on the PyPI page (#726) · 926ac01b
  Yineng Zhang authored Jul 25, 2024
  
  926ac01b
- chore: bump v0.1.25 (#725) · 25c881a0
  Yineng Zhang authored Jul 25, 2024
  
  25c881a0
- Fix dockerfile and triton cache manager (#720) · 04ec6ba2
  Liangsheng Yin authored Jul 25, 2024
  
  04ec6ba2
- fix: fp8 config (#723) · d63f13c1
  Ying Sheng authored Jul 25, 2024
  
  d63f13c1
- misc: update bulid instruction (#724) · fded6744
  Yineng Zhang authored Jul 25, 2024
  
  fded6744
- chore: add close inactive issues workflow (#722) · 6e453940
  Yineng Zhang authored Jul 25, 2024
  
  6e453940
- docs: update comment (#721) · 97e0f7d2
  Yineng Zhang authored Jul 25, 2024
  
  97e0f7d2
24 Jul, 2024 13 commits
- docs: update supported models (#719) · d5146bae
  Yineng Zhang authored Jul 25, 2024
  
  d5146bae
- Bump version to 0.1.24 (#718) · 459abad2
  Ying Sheng authored Jul 24, 2024
  
  459abad2
- Improve benchmark scripts (#717) · 30d8e130
  Ying Sheng authored Jul 24, 2024
  
  30d8e130
- docs: update doc (#716) · 08a3bd19
  Ying Sheng authored Jul 24, 2024
  
  08a3bd19
- misc: update doc (#715) · 321a963b
  Yineng Zhang authored Jul 25, 2024
  
  321a963b
- fix: llama 3.1 405b fp8 (#714) · e17deb27
  Yineng Zhang authored Jul 25, 2024
  
  e17deb27
- docs: update doc (#713) · 2d3ae4e1
  Yineng Zhang authored Jul 25, 2024
  
  2d3ae4e1
- docs: update README (#712) · 75f4ccb7
  Yineng Zhang authored Jul 24, 2024
  
  75f4ccb7
- format · 83d2b30d
  Ying Sheng authored Jul 24, 2024
  
  83d2b30d
- Fix prefill size (#711) · 4367f4bb
  Ying Sheng authored Jul 24, 2024
  
  4367f4bb
- Update schedule_heuristic.py · 00e4baa7
  Lianmin Zheng authored Jul 24, 2024
  
  00e4baa7
- Auto adjust new ratio (#708) · 4cd64b8e
  Liangsheng Yin authored Jul 23, 2024
  
  4cd64b8e
- Fix multi-node deadlock (#709) · 01d66ae2
  Lianmin Zheng authored Jul 23, 2024
  
  01d66ae2