Commits · 6b0f2e908815acc3dbcf6630b5cdff4b9fbece72 · change / sglang · GitLab

30 Jul, 2024 17 commits
- Add `--max-total-tokens` (#840) · 6b0f2e90
  Liangsheng Yin authored Jul 30, 2024
  
  6b0f2e90
- chore: bump v0.2.7 (#830) · 1edd4e07
  Yineng Zhang authored Jul 30, 2024
  
  1edd4e07
- docs: add set up runner (#829) · 62c673c4
  Yineng Zhang authored Jul 30, 2024
  
  62c673c4
- misc: enable e2e test when push (#828) · 377c5dc9
  Yineng Zhang authored Jul 30, 2024
  
  377c5dc9
- misc: update e2e test benchmark config (#825) · f52eda35
  Yineng Zhang authored Jul 30, 2024
  
  f52eda35
- Add awq_marlin (#826) · b579ecf0
  Ying Sheng authored Jul 30, 2024
  
  b579ecf0
- Adjust default mem fraction to avoid OOM (#823) · e7487b08
  Ying Sheng authored Jul 30, 2024
  
  e7487b08
- Support disable_ignore_eos in bench_serving.py (#824) · ae5c0fc4
  Ying Sheng authored Jul 30, 2024
  
  ae5c0fc4
- feat: add pr e2e test (#822) · a30d5d75
  Yineng Zhang authored Jul 30, 2024
  
  a30d5d75
- feat: add runner (#821) · 17af39c5
  Yineng Zhang authored Jul 30, 2024
  
  17af39c5
- Fix streaming bug (#820) · daf593a3
  ObjectNotFound authored Jul 30, 2024
  
  daf593a3
- docs: update README (#819) · bece265f
  Yineng Zhang authored Jul 30, 2024
  
  bece265f
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
- Fix LiteLLM kwargs (#817) · 21e22b9e
  Enrique Shockwave authored Jul 30, 2024
  
  21e22b9e
- fix: use v0.2.5 for benchmark (#814) · a50c8a14
  Yineng Zhang authored Jul 30, 2024
  
  a50c8a14
- Revert "Organize public APIs" (#815) · db6089e6
  Ying Sheng authored Jul 29, 2024
  
  db6089e6
- Remove inf value for chunked prefill size (#812) · 3520f75f
  Liangsheng Yin authored Jul 29, 2024
  
  3520f75f
29 Jul, 2024 15 commits
- Organize public APIs (#809) · c8e9fed8
  Liangsheng Yin authored Jul 29, 2024
  
  c8e9fed8
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
- Revert "Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118"" (#806) · eba458bd
  Ying Sheng authored Jul 29, 2024
  
  eba458bd
- feat: add chat template for internlm2-chat (#802) · 3d1cb0af
  Yineng Zhang authored Jul 30, 2024
  
  3d1cb0af
- Revert "fix: update flashinfer to 0.1.2 to fix sampling for cu118" (#805) · 7d352b4f
  Ying Sheng authored Jul 29, 2024
  
  7d352b4f
- fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803) · 87064015
  Yineng Zhang authored Jul 30, 2024
  
  87064015
- Chunked prefill (#800) · 7cd4f244
  Liangsheng Yin authored Jul 29, 2024
  
  7cd4f244
- Revert "Chunked prefill support" (#799) · 98111fbe
  Ying Sheng authored Jul 29, 2024
  
  98111fbe
- Chunked prefill support (#797) · 2ec39ab7
  Liangsheng Yin authored Jul 29, 2024
  
  2ec39ab7
- Add role documentation, add system begin & end tokens (#793) · 8f6274c8
  ObjectNotFound authored Jul 29, 2024
  
  8f6274c8
- Fix logging (#796) · 325a06c2
  Ying Sheng authored Jul 28, 2024
  
  325a06c2
- Fix lazy import location (#795) · 79f81629
  Ying Sheng authored Jul 28, 2024
  
  79f81629
- Lazy-import third-party backends (#794) · b688fd85
  Eric Yoon authored Jul 29, 2024
  
  b688fd85
- Update README.md (#792) · 5bd89924
  Ying Sheng authored Jul 28, 2024
  
  5bd89924
- Fix echo + lobprob for OpenAI API when the prompt is a list (#791) · 8d908a93
  Ying Sheng authored Jul 28, 2024
  
  8d908a93
28 Jul, 2024 8 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- docs: make badges center (#789) · 1f013d64
  Yineng Zhang authored Jul 28, 2024
  
  1f013d64
- docs: update README (#788) · 628e1fa7
  Yineng Zhang authored Jul 28, 2024
  
  628e1fa7
- Vectorize logprobs computation (#787) · c71880f8
  Ying Sheng authored Jul 28, 2024
  
  c71880f8
- Update README.md · bcb6611a
  Ying Sheng authored Jul 28, 2024
  
  bcb6611a
- docs: update index (#786) · fa2aa0db
  Yineng Zhang authored Jul 28, 2024
  
  fa2aa0db
- fix: exclude logo png in gitignore (#785) · 6a387a69
  Yineng Zhang authored Jul 28, 2024
  
  6a387a69
- fix: init readthedocs support (#784) · 27f5ce0a
  Yineng Zhang authored Jul 28, 2024
  
  27f5ce0a