Commits · 5a57b8addd3fc6fc40e7a605750e327d84141aec · change / sglang

"sgl-kernel/python/sgl_kernel/testing/rotary_embedding.py" did not exist on "fcc11e5ed52e723180bf87d0a6e2c7eaebfad21a"

05 Jul, 2024 1 commit
- Add Gemma2 (#592) · 5a57b8ad
  Ying Sheng authored Jul 05, 2024
  
  5a57b8ad
04 Jul, 2024 1 commit
- fix flashinfer & http log level · 63fbef98
  Lianmin Zheng authored Jul 03, 2024
  
  63fbef98
03 Jul, 2024 1 commit
- 2x performance improvement for large prefill & Fix workspace conflicts (#579) · 2a754e57
  Ying Sheng authored Jul 03, 2024
  
  2a754e57
02 Jul, 2024 1 commit
- Turn on flashinfer by default (#578) · 9380f50f
  Ying Sheng authored Jul 02, 2024
  
  9380f50f
01 Jul, 2024 1 commit
- Update run_batch interface and max_prefill_tokens (#574) · 75b31a2a
  Ying Sheng authored Jun 30, 2024
  
  75b31a2a
07 Jun, 2024 1 commit
- Improve logging & fix litellm dependency. (#512) · c0ae70c8
  Lianmin Zheng authored Jun 07, 2024
  
  c0ae70c8
01 Jun, 2024 2 commits
- Improve docs · 9f009261
  Lianmin Zheng authored Jun 01, 2024
  
  9f009261
- Make the server random by default (#493) · 159cc741
  Lianmin Zheng authored May 31, 2024
  
  159cc741
28 May, 2024 1 commit
- Update docs (#486) · adc97426
  Lianmin Zheng authored May 27, 2024
  
  adc97426
12 May, 2024 2 commits
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
- Misc fixes (#432) · 6e09cf6a
  Lianmin Zheng authored May 12, 2024
  
  6e09cf6a
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
11 Mar, 2024 2 commits
- Update version to v0.1.13 (#280) · 4aa5dd2c
  Lianmin Zheng authored Mar 11, 2024
  
  4aa5dd2c
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
11 Feb, 2024 1 commit
- Update version to 0.1.12 (#178) · 624b21e7
  Lianmin Zheng authored Feb 11, 2024
  
  624b21e7
07 Feb, 2024 1 commit
- [Submodule] Change FlashInfer to import (#156) · 26c34941
  Cody Yu authored Feb 06, 2024
  
  26c34941
31 Jan, 2024 1 commit
- Update sampling_params.md · 876db8dc
  Lianmin Zheng authored Jan 31, 2024
  
  876db8dc
30 Jan, 2024 1 commit
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
18 Jan, 2024 1 commit
- Document sampling parameters (#45) · 05b4c398
  Lianmin Zheng authored Jan 18, 2024
  
  05b4c398
16 Jan, 2024 2 commits
- Update docs (#12) · e71d4ab3
  Lianmin Zheng authored Jan 16, 2024
  
  e71d4ab3
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081