Commits · 13662fd5336fc8428e130567fdb1695d664eea24 · zhaoyu6 / sglang

"examples/fp8/extract_scales.py" did not exist on "e6dcd9bd508da5e3d14ac000eb2398933c872774"

11 Mar, 2024 2 commits
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
30 Jan, 2024 1 commit
- Improve the control of streaming and improve the first token latency in streaming (#117) · 6f560c76
  Lianmin Zheng authored Jan 29, 2024
  
  6f560c76
19 Jan, 2024 1 commit
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081