Commits · fa2aa0db0afe09630c58b26ed5e29ea0b3dc936b · change / sglang

28 Jul, 2024 12 commits
- docs: update index (#786) · fa2aa0db
  Yineng Zhang authored Jul 28, 2024
  
  fa2aa0db
- fix: exclude logo png in gitignore (#785) · 6a387a69
  Yineng Zhang authored Jul 28, 2024
  
  6a387a69
- fix: init readthedocs support (#784) · 27f5ce0a
  Yineng Zhang authored Jul 28, 2024
  
  27f5ce0a
- docs: init readthedocs support (#783) · 94862579
  Yineng Zhang authored Jul 28, 2024
  
  94862579
- fix: replace pillow with PIL in PACKAGE_LIST (#781) · 68e52626
  Yineng Zhang authored Jul 28, 2024
  
  68e52626
- Bump version to 0.2.6 (#779) · bc1154c3
  Lianmin Zheng authored Jul 27, 2024
  
  bc1154c3
- Allow disabling flashinfer sampling kernel (#778) · 752e6430
  Lianmin Zheng authored Jul 27, 2024
  
  752e6430
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
- Fix return_log_probs with cuda graph (#775) · 0a409bd4
  Lianmin Zheng authored Jul 27, 2024
  
  0a409bd4
- minor refactor: move check server args to server_args.py (#774) · e4db4e5b
  Mingyi authored Jul 27, 2024
  
  e4db4e5b
- Move sampling logits to float32 (#773) · bbc07c41
  Lianmin Zheng authored Jul 27, 2024
  
  bbc07c41
- Fix max new tokens (#772) · a036d419
  Lianmin Zheng authored Jul 27, 2024
  
  a036d419
27 Jul, 2024 11 commits
- Fix max_tokens for OpenAI chat completion API (#766) · f95e6617
  Lianmin Zheng authored Jul 27, 2024
  
  f95e6617
- feat: add fake tag (#770) · de854fb5
  Yineng Zhang authored Jul 28, 2024
  
  de854fb5
- Add slack invitation link. · f64b2a9b
  Lianmin Zheng authored Jul 27, 2024
  
  f64b2a9b
- Update readme (#769) · 9f95dcc6
  Ying Sheng authored Jul 27, 2024
```
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
```
  9f95dcc6
- [Minor] Improve the code style in TokenizerManager (#767) · 0736b270
  Lianmin Zheng authored Jul 27, 2024
  
  0736b270
- Fix TransformerTokenizer init for chatglm2 & 3 (#761) · 3fdab919
  Ke Bao authored Jul 27, 2024
  
  3fdab919
- Update supported models (#763) · ba29504b
  Liangsheng Yin authored Jul 26, 2024
  
  ba29504b
- fix: not run workflows on fork repo (#762) · a72342f1
  Yineng Zhang authored Jul 27, 2024
  
  a72342f1
- docs: update model support (#760) · c3c74bf8
  Yineng Zhang authored Jul 27, 2024
  
  c3c74bf8
- Fix context length (#757) · d9fccfef
  Liangsheng Yin authored Jul 26, 2024
  
  d9fccfef
- Deepseek v2 support (#693) · 679ebcbb
  Liangsheng Yin authored Jul 26, 2024
  
  679ebcbb
26 Jul, 2024 13 commits
- fix: use REPO_TOKEN (#755) · 5bd06b45
  Yineng Zhang authored Jul 27, 2024
  
  5bd06b45
- fix: add release tag workflow (#754) · 9a611827
  Yineng Zhang authored Jul 27, 2024
  
  9a611827
- feat: add release tag workflow (#753) · eeb24821
  Yineng Zhang authored Jul 27, 2024
  
  eeb24821
- misc: replace deprecated variable HUGGING_FACE_HUB_TOKEN with HF_TOKEN (#752) · 3e455b01
  Yineng Zhang authored Jul 27, 2024
  
  3e455b01
- feat: add docker workflow (#751) · 8628ab9c
  Yineng Zhang authored Jul 27, 2024
  
  8628ab9c
- chore: bump v0.2.1 (#740) · 1b77670f
  Yineng Zhang authored Jul 26, 2024
  
  1b77670f
- fix benchmark (#743) · 768e05d0
  Yineng Zhang authored Jul 26, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  768e05d0
- docs: fix typo (#742) · 01fbb11b
  Yineng Zhang authored Jul 26, 2024
  
  01fbb11b
- docs: add llama 3.1 405b instruction (#739) · 05d216da
  Yineng Zhang authored Jul 26, 2024
```
Co-authored-by: Ying1123 <sqy1415@gmail.com>
```
  05d216da
- misc: format (#741) · 6b32bb1c
  Yineng Zhang authored Jul 26, 2024
  
  6b32bb1c
- feat: support token ids in /v1/completions (#736) · 40facad5
  Toshiki Kataoka authored Jul 26, 2024
  
  40facad5
- fix /generate without sampling_params (#734) · da504445
  Toshiki Kataoka authored Jul 26, 2024
  
  da504445
- fix: small bug for llama-405b fp16 (#733) · 252e0f7b
  Ying Sheng authored Jul 25, 2024
  
  252e0f7b
25 Jul, 2024 4 commits
- Update readme (#731) · 7f6f2f0f
  Ying Sheng authored Jul 25, 2024
  
  7f6f2f0f
- Update readme · 7802df1e
  Ying Sheng authored Jul 25, 2024
  
  7802df1e
- Bump version to 0.2.0 (#730) · 1a491d00
  Ying Sheng authored Jul 25, 2024
  
  1a491d00
- Fix bugs (fp8 checkpoints, triton cache manager) (#729) · 8fbba3de
  Ying Sheng authored Jul 25, 2024
  
  8fbba3de