Commits · 11616fc6bd0ca9c156144839fedf586c2aa9a0e5 · change / sglang

30 Jun, 2024 1 commit
- Minor fix in compiler & format (#545) · 11616fc6
  sglang authored Jun 29, 2024
  
  11616fc6
27 Jun, 2024 1 commit
- Update readme (#568) · 945aa9be
  Lianmin Zheng authored Jun 27, 2024
  
  945aa9be
26 Jun, 2024 1 commit
- Increase the number of thread limitation for tp worker managers. (#567) · 2e6e62e1
  Lianmin Zheng authored Jun 26, 2024
  
  2e6e62e1
25 Jun, 2024 1 commit
- Warmup cublas (#566) · a385ee27
  Lianmin Zheng authored Jun 25, 2024
  
  a385ee27
22 Jun, 2024 1 commit
- Fix latency benchmark (#557) · 92cb93f3
  Liangsheng Yin authored Jun 22, 2024
  
  92cb93f3
18 Jun, 2024 1 commit
- Multi-node Tensor Parallelism (#550) · 09593e9b
  Ying Sheng authored Jun 17, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  09593e9b
13 Jun, 2024 3 commits
- Add disk cache for loading ShareGPT dataset. (#542) · 40e53d65
  Liangsheng Yin authored Jun 13, 2024
  
  40e53d65
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
- Fix dependency & crash issues (#539) · 1374334d
  Ying Sheng authored Jun 12, 2024
  
  1374334d
04 Jun, 2024 1 commit
- [Minor] improve code style · 3bc01ac1
  Lianmin Zheng authored Jun 03, 2024
  
  3bc01ac1
27 May, 2024 1 commit
- Improve benchmark scripts & add more models (#484) · 09de730d
  Lianmin Zheng authored May 27, 2024
  
  09de730d
26 May, 2024 2 commits
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
- Add benchmark scripts (#476) · 947bda73
  Ying Sheng authored May 26, 2024
  
  947bda73
24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
13 May, 2024 1 commit
- Update readme (#434) · 455c9ccc
  Lianmin Zheng authored May 13, 2024
  
  455c9ccc
12 May, 2024 1 commit
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
05 May, 2024 1 commit
- Organize Benchmark (#381) · 14522e6a
  Liangsheng Yin authored May 05, 2024
  
  14522e6a
28 Apr, 2024 1 commit
- Format Benchmark Code (#399) · 95c4e0df
  Liangsheng Yin authored Apr 28, 2024
  
  95c4e0df
23 Apr, 2024 1 commit
- Benchmark Updates (#382) · da19434c
  Liangsheng Yin authored Apr 24, 2024
  
  da19434c
22 Mar, 2024 1 commit
- Support oai in benchmark/mmlu (#323) · e2b2f0a2
  Lianmin Zheng authored Mar 22, 2024
  
  e2b2f0a2
24 Feb, 2024 1 commit
- Upload `agent_calls.jsonl` download link (#226) · ec90b9c0
  Liangsheng Yin authored Feb 24, 2024
  
  ec90b9c0
05 Feb, 2024 2 commits
- improve docs · 8ff870bf
  Lianmin Zheng authored Feb 05, 2024
  
  8ff870bf
- jump-forward rename (#144) · 26f0bedc
  Liangsheng Yin authored Feb 05, 2024
  
  26f0bedc
02 Feb, 2024 1 commit
- minor fix: result dump format · 9c121f2a
  hnyls2002 authored Feb 02, 2024
  
  9c121f2a
01 Feb, 2024 1 commit
- Add city doc benchmark mode (#129) · 79cb018e
  Liangsheng Yin authored Feb 01, 2024
  
  79cb018e
30 Jan, 2024 1 commit
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
24 Jan, 2024 2 commits
- fast regex decode · 01ee0fbc
  Liangsheng Yin authored Jan 25, 2024
```
Auto-detect constant str path in regex FSM, then extend instead.
```
  01ee0fbc
- add a batch llava example · 711d3435
  Lianmin Zheng authored Jan 24, 2024
  
  711d3435
18 Jan, 2024 1 commit
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
16 Jan, 2024 1 commit
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
15 Jan, 2024 2 commits
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081