Commits · 916b3cdddcbaa0f902a27fac0a1ec02f72cd62e9 · change / sglang

03 Nov, 2024 1 commit
- Allow passing dtype and max_new_tokens to HF reference script (#1903) · 916b3cdd
  Jani Monoses authored Nov 03, 2024
  
  916b3cdd
31 Oct, 2024 1 commit
- Fix memory leak for chunked prefill 2 (#1858) · a2e0424a
  Lianmin Zheng authored Oct 31, 2024
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  a2e0424a
30 Oct, 2024 1 commit
- Update docs (#1839) · b548801d
  Lianmin Zheng authored Oct 30, 2024
  
  b548801d
26 Oct, 2024 1 commit
- Update ci workflows (#1804) · 6aa94b96
  Lianmin Zheng authored Oct 26, 2024
  
  6aa94b96
07 Oct, 2024 1 commit
- [Profile] Add pytorch profiler (#1604) · c5325aba
  Ying Sheng authored Oct 07, 2024
  
  c5325aba
30 Sep, 2024 1 commit
- Organize Attention Backends (#1547) · 99ec439d
  Liangsheng Yin authored Sep 30, 2024
  
  99ec439d
25 Sep, 2024 1 commit
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
23 Sep, 2024 1 commit
- Fix the overhead due to penalizer in bench_latency (#1496) · 2854a5ea
  Lianmin Zheng authored Sep 23, 2024
  
  2854a5ea
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
19 Sep, 2024 1 commit
- Fix env vars in bench_latency (#1472) · 2cd7e181
  Lianmin Zheng authored Sep 19, 2024
  
  2cd7e181
15 Sep, 2024 1 commit
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
10 Sep, 2024 1 commit
- [Minor] move triton attention kernels into a separate folder (#1379) · 3a6e8b6d
  Lianmin Zheng authored Sep 10, 2024
  
  3a6e8b6d
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
14 Aug, 2024 1 commit
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
08 Aug, 2024 1 commit
- #590 Increase default , track changes in examples and documentation (#971) · c62d560c
  foszto authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  c62d560c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
01 Aug, 2024 1 commit
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
17 Jul, 2024 1 commit
- misc: add pre-commit config (#637) · 2e341cd4
  zhyncs authored Jul 18, 2024
  
  2e341cd4
28 Apr, 2024 1 commit
- Format Benchmark Code (#399) · 95c4e0df
  Liangsheng Yin authored Apr 28, 2024
  
  95c4e0df
01 Feb, 2024 1 commit
- Yi-VL Model (#112) · 86442530
  Christopher Chou authored Feb 01, 2024
  
  86442530
16 Jan, 2024 1 commit
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
09 Jan, 2024 1 commit
- Add install with pip (#3) · 30720e73
  Lianmin Zheng authored Jan 09, 2024
  
  30720e73