Commits · 1b7adbb5a0cfb6826e8b7d45807fc3900b4a5f25 · zhaoyu6 / sglang

"official/legacy/transformer/optimizer.py" did not exist on "47e783e62a41f1f19baffc316d6530315ea872ac"

19 Jul, 2024 2 commits
- `TokenizerManager.context_len` should inherit from `server_args.conte… (#654) · 1b7adbb5
  shrirajh authored Jul 19, 2024
  
  1b7adbb5
- Detokenize incrementally when streaming (#653) · a9ef49c1
  Liangsheng Yin authored Jul 18, 2024
  
  a9ef49c1
18 Jul, 2024 7 commits
- Remove useless variables in infer_batch.py (#651) · 21ba3a88
  Ying Sheng authored Jul 18, 2024
  
  21ba3a88
- fix: resolve lint error (#650) · 9c5cac24
  zhyncs authored Jul 18, 2024
  
  9c5cac24
- feat: add lint workflow (#648) · 5960a6e5
  zhyncs authored Jul 18, 2024
  
  5960a6e5
- fix: set ulimit -n 65535 (#647) · b050d928
  zhyncs authored Jul 18, 2024
  
  b050d928
- misc: rm rpyc from PACKAGE_LIST (#649) · 6a4dc996
  zhyncs authored Jul 18, 2024
  
  6a4dc996
- Remove the dependency of rpyc (#646) · d774acad
  Mingyi authored Jul 18, 2024
  
  d774acad
- feat: add check_env (#645) · d93388da
  zhyncs authored Jul 18, 2024
  
  d93388da
17 Jul, 2024 8 commits
- Increase the capacity of the memory pool (#643) · 476584cb
  Ying Sheng authored Jul 17, 2024
  
  476584cb
- Move `global_server_args_dict` (#642) · abd5385a
  Liangsheng Yin authored Jul 17, 2024
  
  abd5385a
- Flashinfer sample kernel (#617) · 3de2f30a
  Liangsheng Yin authored Jul 17, 2024
  
  3de2f30a
- misc: add issue and pr template (#638) · 4efcc59d
  zhyncs authored Jul 18, 2024
  
  4efcc59d
- misc: add pre-commit config (#637) · 2e341cd4
  zhyncs authored Jul 18, 2024
  
  2e341cd4
- feat: support internlm2 (#636) · a8552cb1
  zhyncs authored Jul 17, 2024
  
  a8552cb1
- clean up step function (#635) · a470e60c
  Ying Sheng authored Jul 16, 2024
  
  a470e60c
- Update README.md · 5f90e076
  Ying Sheng authored Jul 16, 2024
  
  5f90e076
16 Jul, 2024 8 commits
- Reduce docker size (#632) · 8832ecb1
  Liangsheng Yin authored Jul 16, 2024
  
  8832ecb1
- Fix vertexai (#633) · 5ff60eda
  Liangsheng Yin authored Jul 16, 2024
  
  5ff60eda
- Add support for VertexAI safety settings (#624) · c1930022
  Aidan Cooper authored Jul 16, 2024
  
  c1930022
- Add qwen2 tie word embedding (#630) · fe3be159
  ylying authored Jul 17, 2024
  
  fe3be159
- Disable NCCL_NVLS by default (#631) · 0aa189f1
  Ying Sheng authored Jul 16, 2024
  
  0aa189f1
- Update docker file (#629) · f6b29f69
  Ying Sheng authored Jul 16, 2024
  
  f6b29f69
- Fix model forward grad (#628) · c9ee3d35
  Liangsheng Yin authored Jul 15, 2024
  
  c9ee3d35
- Fix flush cache (#627) · 41d1f677
  Lianmin Zheng authored Jul 15, 2024
  
  41d1f677
15 Jul, 2024 3 commits
- Bump version to 0.1.21 (#626) · 56f5fc4a
  Ying Sheng authored Jul 15, 2024
  
  56f5fc4a
- Improve tensor parallel performance (#625) · 6a2941f4
  Ying Sheng authored Jul 15, 2024
```
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
```
  6a2941f4
- Simplify mem state (#623) · 5ac8b806
  Mingyi authored Jul 15, 2024
  
  5ac8b806
14 Jul, 2024 4 commits
- Update benchmark script (#621) · bae9541e
  Ying Sheng authored Jul 14, 2024
  
  bae9541e
- Unify index operations (#620) · a56858ba
  Liangsheng Yin authored Jul 14, 2024
  
  a56858ba
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
- Bump version to 0.1.20 (#618) · 5d264a90
  Lianmin Zheng authored Jul 13, 2024
  
  5d264a90
13 Jul, 2024 6 commits
- Fix memory pool index error (#616) · 5949b1ca
  Ying Sheng authored Jul 13, 2024
  
  5949b1ca
- Improve benchmark scripts (#615) · 0feca02d
  Lianmin Zheng authored Jul 13, 2024
  
  0feca02d
- Memorypool chunked prefetch (#614) · 10143e1a
  Liangsheng Yin authored Jul 13, 2024
  
  10143e1a
- Improve benchmark scripts & fix llava (#613) · 65c65776
  Lianmin Zheng authored Jul 13, 2024
  
  65c65776
- Enable cuda graph by default (#612) · 66581596
  Lianmin Zheng authored Jul 13, 2024
  
  66581596
- Cleanup attention backend: flashinfer and triton (#611) · 396a6924
  Lianmin Zheng authored Jul 12, 2024
  
  396a6924
12 Jul, 2024 2 commits
- Clean up the usage of flashinfer (#610) · af4e7910
  Lianmin Zheng authored Jul 12, 2024
  
  af4e7910
- Code clean up: Remove deprecated prefill move InputMetadata to infer_batch.py (#609) · 519e20cf
  Lianmin Zheng authored Jul 12, 2024
  
  519e20cf