Commits · 3f0fe08d3748dfd5aa70f4620bb44bdd6765e335 · zhaoyu6 / sglang

19 Sep, 2024 1 commit
- feat: update linear deps 1/N (#1305) · b4408b0d
  Yineng Zhang authored Sep 19, 2024
  
  b4408b0d
14 Sep, 2024 2 commits
- Add torchao quant for mixtral and qwen_moe (#1418) · 30b404ce
  Jerry Zhang authored Sep 13, 2024
  
  30b404ce
- Optimize conflicts between CUDA graph and vocab mask tensors (#1392) · 70b68029
  Liangsheng Yin authored Sep 13, 2024
  
  70b68029
01 Sep, 2024 1 commit
- fix: resolve fp8 for mixtral (#1290) · 9b080524
  Yineng Zhang authored Sep 02, 2024
  
  9b080524
29 Aug, 2024 1 commit
- Sampler cudagraph (#1253) · 381dd57b
  Liangsheng Yin authored Aug 28, 2024
  
  381dd57b
28 Aug, 2024 1 commit
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
26 Aug, 2024 1 commit
- Move sampler into CUDA graph (#1201) · 75ce37f4
  Liangsheng Yin authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  75ce37f4
14 Aug, 2024 2 commits
- Use `dtype` to control generate (#1082) · a34dd86a
  Liangsheng Yin authored Aug 14, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a34dd86a
- Update grok 1 model (#1095) · a59636bb
  Lianmin Zheng authored Aug 14, 2024
  
  a59636bb
13 Aug, 2024 1 commit
- Update the mixtral to use the better FusedMoE layer (#1081) · ad3e4f16
  Lianmin Zheng authored Aug 13, 2024
  
  ad3e4f16
12 Aug, 2024 1 commit
- feat: replace all rmsnorm and silu (#1057) · 6a38efa8
  Yineng Zhang authored Aug 13, 2024
  
  6a38efa8
07 Aug, 2024 1 commit
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
16 Jul, 2024 1 commit
- Fix model forward grad (#628) · c9ee3d35
  Liangsheng Yin authored Jul 15, 2024
  
  c9ee3d35
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
07 Jun, 2024 1 commit

Lianmin Zheng authored Jun 07, 2024


Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>

bf3e271f

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

21 May, 2024 2 commits
- port fp8 mixtral (#460) · 0fafc560
  Lianmin Zheng authored May 21, 2024
  
  0fafc560
- Use model loader from vllm (#459) · 19d2135c
  Lianmin Zheng authored May 21, 2024
  
  19d2135c
13 May, 2024 1 commit
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
11 Mar, 2024 1 commit
- replace skip_embed with input_embeds (#222) · 64fe3115
  Geary.Z authored Mar 11, 2024
  
  64fe3115
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
31 Jan, 2024 1 commit
- Fix model loading & format code (#125) · ad82bac6
  Lianmin Zheng authored Jan 30, 2024
  
  ad82bac6
30 Jan, 2024 1 commit
- Format code (#118) · 4ea92f83
  Lianmin Zheng authored Jan 29, 2024
  
  4ea92f83
25 Jan, 2024 1 commit
- Dynamic model class loading (#101) · 3a581e99
  Cody Yu authored Jan 25, 2024
  
  3a581e99
17 Jan, 2024 1 commit
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
16 Jan, 2024 1 commit
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081