Commits · 6b32bb1c0b95480c1f4534d026bede81bb3fcc83 · change / sglang

26 Jul, 2024 4 commits
- misc: format (#741) · 6b32bb1c
  Yineng Zhang authored Jul 26, 2024
  
  6b32bb1c
- feat: support token ids in /v1/completions (#736) · 40facad5
  Toshiki Kataoka authored Jul 26, 2024
  
  40facad5
- fix /generate without sampling_params (#734) · da504445
  Toshiki Kataoka authored Jul 26, 2024
  
  da504445
- fix: small bug for llama-405b fp16 (#733) · 252e0f7b
  Ying Sheng authored Jul 25, 2024
  
  252e0f7b
25 Jul, 2024 13 commits
- Update readme (#731) · 7f6f2f0f
  Ying Sheng authored Jul 25, 2024
  
  7f6f2f0f
- Update readme · 7802df1e
  Ying Sheng authored Jul 25, 2024
  
  7802df1e
- Bump version to 0.2.0 (#730) · 1a491d00
  Ying Sheng authored Jul 25, 2024
  
  1a491d00
- Fix bugs (fp8 checkpoints, triton cache manager) (#729) · 8fbba3de
  Ying Sheng authored Jul 25, 2024
  
  8fbba3de
- Revert "fix: fp8 config" (#728) · ae0f6130
  Ying Sheng authored Jul 25, 2024
  
  ae0f6130
- misc: update bug issue template (#727) · 60105897
  Yineng Zhang authored Jul 25, 2024
  
  60105897
- fix: resolve the logo display issue on the PyPI page (#726) · 926ac01b
  Yineng Zhang authored Jul 25, 2024
  
  926ac01b
- chore: bump v0.1.25 (#725) · 25c881a0
  Yineng Zhang authored Jul 25, 2024
  
  25c881a0
- Fix dockerfile and triton cache manager (#720) · 04ec6ba2
  Liangsheng Yin authored Jul 25, 2024
  
  04ec6ba2
- fix: fp8 config (#723) · d63f13c1
  Ying Sheng authored Jul 25, 2024
  
  d63f13c1
- misc: update bulid instruction (#724) · fded6744
  Yineng Zhang authored Jul 25, 2024
  
  fded6744
- chore: add close inactive issues workflow (#722) · 6e453940
  Yineng Zhang authored Jul 25, 2024
  
  6e453940
- docs: update comment (#721) · 97e0f7d2
  Yineng Zhang authored Jul 25, 2024
  
  97e0f7d2
24 Jul, 2024 13 commits
- docs: update supported models (#719) · d5146bae
  Yineng Zhang authored Jul 25, 2024
  
  d5146bae
- Bump version to 0.1.24 (#718) · 459abad2
  Ying Sheng authored Jul 24, 2024
  
  459abad2
- Improve benchmark scripts (#717) · 30d8e130
  Ying Sheng authored Jul 24, 2024
  
  30d8e130
- docs: update doc (#716) · 08a3bd19
  Ying Sheng authored Jul 24, 2024
  
  08a3bd19
- misc: update doc (#715) · 321a963b
  Yineng Zhang authored Jul 25, 2024
  
  321a963b
- fix: llama 3.1 405b fp8 (#714) · e17deb27
  Yineng Zhang authored Jul 25, 2024
  
  e17deb27
- docs: update doc (#713) · 2d3ae4e1
  Yineng Zhang authored Jul 25, 2024
  
  2d3ae4e1
- docs: update README (#712) · 75f4ccb7
  Yineng Zhang authored Jul 24, 2024
  
  75f4ccb7
- format · 83d2b30d
  Ying Sheng authored Jul 24, 2024
  
  83d2b30d
- Fix prefill size (#711) · 4367f4bb
  Ying Sheng authored Jul 24, 2024
  
  4367f4bb
- Update schedule_heuristic.py · 00e4baa7
  Lianmin Zheng authored Jul 24, 2024
  
  00e4baa7
- Auto adjust new ratio (#708) · 4cd64b8e
  Liangsheng Yin authored Jul 23, 2024
  
  4cd64b8e
- Fix multi-node deadlock (#709) · 01d66ae2
  Lianmin Zheng authored Jul 23, 2024
  
  01d66ae2
23 Jul, 2024 7 commits
- Reduce hardcoded logic of kernel usage (#707) · a523a3c1
  Mingyi authored Jul 23, 2024
  
  a523a3c1
- bump version to 0.1.23 (#706) · 9f94728f
  Ying Sheng authored Jul 23, 2024
  
  9f94728f
- Update vllm version to support llama3.1 (#705) · 444a0244
  Ying Sheng authored Jul 23, 2024
  
  444a0244
- feat: add e2e latency (#704) · fa7ccb33
  zhyncs authored Jul 24, 2024
  
  fa7ccb33
- Use min new token ratio at start (#701) · 26868443
  Liangsheng Yin authored Jul 23, 2024
  
  26868443
- Fix hf config loading (#702) · 824a77d0
  Ke Bao authored Jul 24, 2024
  
  824a77d0
- Fix flashinfer (#700) · cf99eab7
  Ying Sheng authored Jul 23, 2024
  
  cf99eab7
22 Jul, 2024 3 commits
- misc: fix typo (#698) · 9fdea29d
  zhyncs authored Jul 23, 2024
  
  9fdea29d
- Fix trt benchmark (#697) · df7c4c19
  Ying Sheng authored Jul 22, 2024
  
  df7c4c19
- Tune params (#696) · c3f1aac8
  Ying Sheng authored Jul 22, 2024
  
  c3f1aac8