Commits · e17deb27b5cb3417c0315791ceddb5b4e40e7e91 · change / sglang

"vscode:/vscode.git/clone" did not exist on "2ac5586e8a6d5dd1f40da8d1a1ae288cac5fafec"

24 Jul, 2024 1 commit
- fix: llama 3.1 405b fp8 (#714) · e17deb27
  Yineng Zhang authored Jul 25, 2024
  
  e17deb27
23 Jul, 2024 1 commit
- Update vllm version to support llama3.1 (#705) · 444a0244
  Ying Sheng authored Jul 23, 2024
  
  444a0244
21 Jul, 2024 1 commit
- Support Mistral-Nemo (#691) · 5303c1ed
  Ke Bao authored Jul 22, 2024
  
  5303c1ed
20 Jul, 2024 1 commit
- refactor model loader: initial refactor (#664) · 06487f12
  Ying Sheng authored Jul 20, 2024
  
  06487f12
17 Jul, 2024 1 commit
- misc: add pre-commit config (#637) · 2e341cd4
  zhyncs authored Jul 18, 2024
  
  2e341cd4
16 Jul, 2024 1 commit
- Fix model forward grad (#628) · c9ee3d35
  Liangsheng Yin authored Jul 15, 2024
  
  c9ee3d35
09 Jul, 2024 1 commit
- add `LogitsMetadata` (#604) · f25b76c0
  Liangsheng Yin authored Jul 08, 2024
  
  f25b76c0
03 Jul, 2024 1 commit
- support gptj style rope in llama · 441cca77
  Chen Xuechen Li authored Jul 03, 2024
  
  441cca77
30 Jun, 2024 1 commit
- Minor fix in compiler & format (#545) · 11616fc6
  sglang authored Jun 29, 2024
  
  11616fc6
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
07 Jun, 2024 1 commit

Lianmin Zheng authored Jun 07, 2024


Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>

bf3e271f

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

21 May, 2024 1 commit
- Use model loader from vllm (#459) · 19d2135c
  Lianmin Zheng authored May 21, 2024
  
  19d2135c
13 May, 2024 1 commit
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
11 Mar, 2024 1 commit
- replace skip_embed with input_embeds (#222) · 64fe3115
  Geary.Z authored Mar 11, 2024
  
  64fe3115
30 Jan, 2024 1 commit
- Format code (#118) · 4ea92f83
  Lianmin Zheng authored Jan 29, 2024
  
  4ea92f83
25 Jan, 2024 1 commit
- Dynamic model class loading (#101) · 3a581e99
  Cody Yu authored Jan 25, 2024
  
  3a581e99
23 Jan, 2024 1 commit
- Support load fine-tuned LLaVA model (#80) · e08bca28
  isaac-vidas authored Jan 22, 2024
  
  e08bca28
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081