Commits · 62832bb2728e0e8ac5f97dc7687eaf263aaa927f · change / sglang

18 Nov, 2024 1 commit
- Support cuda graph for DP attention (#2061) · 62832bb2
  Ke Bao authored Nov 18, 2024
  
  62832bb2
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
03 Nov, 2024 1 commit
- Allow passing dtype and max_new_tokens to HF reference script (#1903) · 916b3cdd
  Jani Monoses authored Nov 03, 2024
  
  916b3cdd
25 Sep, 2024 1 commit
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
23 Sep, 2024 1 commit
- Fix the overhead due to penalizer in bench_latency (#1496) · 2854a5ea
  Lianmin Zheng authored Sep 23, 2024
  
  2854a5ea
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
14 Aug, 2024 1 commit
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
01 Aug, 2024 1 commit
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
17 Jul, 2024 1 commit
- feat: support internlm2 (#636) · a8552cb1
  zhyncs authored Jul 17, 2024
  
  a8552cb1
25 Jun, 2024 1 commit
- Add sglang.bench_latency for offline benchmark (#564) · eb1ae6ae
  Lianmin Zheng authored Jun 25, 2024
  
  eb1ae6ae
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081