Commits · 5a261bd0552c049f7eb14dfd20a1ae43f61c9f46 · change / sglang

16 Aug, 2024 1 commit
- Fix the deadlock in multi-node tp (#1122) · 5a261bd0
  Lianmin Zheng authored Aug 16, 2024
  
  5a261bd0
15 Aug, 2024 1 commit
- Use a single workspace for flashinfer (#1077) · 326df4ba
  Lianmin Zheng authored Aug 14, 2024
  
  326df4ba
14 Aug, 2024 1 commit
- Update grok 1 model (#1095) · a59636bb
  Lianmin Zheng authored Aug 14, 2024
  
  a59636bb
04 Aug, 2024 1 commit
- Support MLA for DeepSeek-V2 with Triton - step 1 (#905) · e1eae1fd
  Ke Bao authored Aug 05, 2024
  
  e1eae1fd
20 Jul, 2024 1 commit
- Fix cuda graph with flashinfer (#675) · 490a1f39
  Lianmin Zheng authored Jul 20, 2024
  
  490a1f39
25 Jun, 2024 1 commit
- Warmup cublas (#566) · a385ee27
  Lianmin Zheng authored Jun 25, 2024
  
  a385ee27
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
26 May, 2024 1 commit
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
05 May, 2024 1 commit
- Organize Benchmark (#381) · 14522e6a
  Liangsheng Yin authored May 05, 2024
  
  14522e6a
28 Apr, 2024 1 commit
- Format Benchmark Code (#399) · 95c4e0df
  Liangsheng Yin authored Apr 28, 2024
  
  95c4e0df
23 Apr, 2024 1 commit
- Benchmark Updates (#382) · da19434c
  Liangsheng Yin authored Apr 24, 2024
  
  da19434c
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081