Commits · 084fa54d371e439cbca8b21930c6f658c1ef4671 · zhaoyu6 / sglang · GitLab

29 Jul, 2024 14 commits
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
- Revert "Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118"" (#806) · eba458bd
  Ying Sheng authored Jul 29, 2024
  
  eba458bd
- feat: add chat template for internlm2-chat (#802) · 3d1cb0af
  Yineng Zhang authored Jul 30, 2024
  
  3d1cb0af
- Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118" (#805) · 7d352b4f
  Ying Sheng authored Jul 29, 2024
  
  7d352b4f
- fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803) · 87064015
  Yineng Zhang authored Jul 30, 2024
  
  87064015
- Chunked prefill (#800) · 7cd4f244
  Liangsheng Yin authored Jul 29, 2024
  
  7cd4f244
- Revert "Chunked prefill support" (#799) · 98111fbe
  Ying Sheng authored Jul 29, 2024
  
  98111fbe
- Chunked prefill support (#797) · 2ec39ab7
  Liangsheng Yin authored Jul 29, 2024
  
  2ec39ab7
- Add role documentation, add system begin & end tokens (#793) · 8f6274c8
  ObjectNotFound authored Jul 29, 2024
  
  8f6274c8
- Fix logging (#796) · 325a06c2
  Ying Sheng authored Jul 28, 2024
  
  325a06c2
- Fix lazy import location (#795) · 79f81629
  Ying Sheng authored Jul 28, 2024
  
  79f81629
- Lazy-import third-party backends (#794) · b688fd85
  Eric Yoon authored Jul 29, 2024
  
  b688fd85
- Update README.md (#792) · 5bd89924
  Ying Sheng authored Jul 28, 2024
  
  5bd89924
- Fix echo + lobprob for OpenAI API when the prompt is a list (#791) · 8d908a93
  Ying Sheng authored Jul 28, 2024
  
  8d908a93
28 Jul, 2024 17 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- docs: make badges center (#789) · 1f013d64
  Yineng Zhang authored Jul 28, 2024
  
  1f013d64
- docs: update README (#788) · 628e1fa7
  Yineng Zhang authored Jul 28, 2024
  
  628e1fa7
- Vectorize logprobs computation (#787) · c71880f8
  Ying Sheng authored Jul 28, 2024
  
  c71880f8
- Update README.md · bcb6611a
  Ying Sheng authored Jul 28, 2024
  
  bcb6611a
- docs: update index (#786) · fa2aa0db
  Yineng Zhang authored Jul 28, 2024
  
  fa2aa0db
- fix: exclude logo png in gitignore (#785) · 6a387a69
  Yineng Zhang authored Jul 28, 2024
  
  6a387a69
- fix: init readthedocs support (#784) · 27f5ce0a
  Yineng Zhang authored Jul 28, 2024
  
  27f5ce0a
- docs: init readthedocs support (#783) · 94862579
  Yineng Zhang authored Jul 28, 2024
  
  94862579
- fix: replace pillow with PIL in PACKAGE_LIST (#781) · 68e52626
  Yineng Zhang authored Jul 28, 2024
  
  68e52626
- Bump version to 0.2.6 (#779) · bc1154c3
  Lianmin Zheng authored Jul 27, 2024
  
  bc1154c3
- Allow disabling flashinfer sampling kernel (#778) · 752e6430
  Lianmin Zheng authored Jul 27, 2024
  
  752e6430
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
- Fix return_log_probs with cuda graph (#775) · 0a409bd4
  Lianmin Zheng authored Jul 27, 2024
  
  0a409bd4
- minor refactor: move check server args to server_args.py (#774) · e4db4e5b
  Mingyi authored Jul 27, 2024
  
  e4db4e5b
- Move sampling logits to float32 (#773) · bbc07c41
  Lianmin Zheng authored Jul 27, 2024
  
  bbc07c41
- Fix max new tokens (#772) · a036d419
  Lianmin Zheng authored Jul 27, 2024
  
  a036d419
27 Jul, 2024 9 commits
- Fix max_tokens for OpenAI chat completion API (#766) · f95e6617
  Lianmin Zheng authored Jul 27, 2024
  
  f95e6617
- feat: add fake tag (#770) · de854fb5
  Yineng Zhang authored Jul 28, 2024
  
  de854fb5
- Add slack invitation link. · f64b2a9b
  Lianmin Zheng authored Jul 27, 2024
  
  f64b2a9b
- Update readme (#769) · 9f95dcc6
  Ying Sheng authored Jul 27, 2024
```
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
```
  9f95dcc6
- [Minor] Improve the code style in TokenizerManager (#767) · 0736b270
  Lianmin Zheng authored Jul 27, 2024
  
  0736b270
- Fix TransformerTokenizer init for chatglm2 & 3 (#761) · 3fdab919
  Ke Bao authored Jul 27, 2024
  
  3fdab919
- Update supported models (#763) · ba29504b
  Liangsheng Yin authored Jul 26, 2024
  
  ba29504b
- fix: not run workflows on fork repo (#762) · a72342f1
  Yineng Zhang authored Jul 27, 2024
  
  a72342f1
- docs: update model support (#760) · c3c74bf8
  Yineng Zhang authored Jul 27, 2024
  
  c3c74bf8