Commits · 5dc54f1a627a1e412c6732777dc2622363df7c21 · change / sglang

17 Jan, 2025 1 commit
- feat: remove vllm distributed (#2907) · 5dc54f1a
  Yineng Zhang authored Jan 17, 2025
```
Co-authored-by: Zhangyi <1109276519@qq.com>
```
  5dc54f1a
02 Dec, 2024 1 commit
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
01 Dec, 2024 2 commits
- Revert "Revert "[FEAT] Support GGUF format"" (#2287) · 4936be8a
  Lianmin Zheng authored Nov 30, 2024
  
  4936be8a
- Revert "[FEAT] Support GGUF format" (#2285) · 7e4c6dd8
  Lianmin Zheng authored Nov 30, 2024
  
  7e4c6dd8
30 Nov, 2024 1 commit
- [FEAT] Support GGUF format (#2215) · 883c9554
  Yang Zheng authored Nov 30, 2024
```
Co-authored-by: Yang Zheng(SW)(Alex) <you@example.com>
```
  883c9554
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
01 Nov, 2024 1 commit
- Update vocab embedding deps and add TP switch (#1856) · 16eb33ff
  Ke Bao authored Nov 01, 2024
  
  16eb33ff
14 Oct, 2024 1 commit
- [1/N] Remove `CacheConfig` import in all model files (#1658) · 56503d9b
  Byron Hsu authored Oct 14, 2024
  
  56503d9b
30 Sep, 2024 1 commit
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc
19 Sep, 2024 1 commit
- feat: update linear deps 1/N (#1305) · b4408b0d
  Yineng Zhang authored Sep 19, 2024
  
  b4408b0d
14 Sep, 2024 1 commit
- Optimize conflicts between CUDA graph and vocab mask tensors (#1392) · 70b68029
  Liangsheng Yin authored Sep 13, 2024
  
  70b68029
29 Aug, 2024 1 commit
- Sampler cudagraph (#1253) · 381dd57b
  Liangsheng Yin authored Aug 28, 2024
  
  381dd57b
28 Aug, 2024 1 commit
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
26 Aug, 2024 1 commit
- Move sampler into CUDA graph (#1201) · 75ce37f4
  Liangsheng Yin authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  75ce37f4
11 Aug, 2024 1 commit
- feat: use FlashInfer rmsnorm and silu (#907) · 94752ac8
  Yineng Zhang authored Aug 11, 2024
  
  94752ac8
07 Aug, 2024 1 commit
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
17 Jul, 2024 1 commit
- feat: support internlm2 (#636) · a8552cb1
  zhyncs authored Jul 17, 2024
  
  a8552cb1
16 Jul, 2024 2 commits
- Add qwen2 tie word embedding (#630) · fe3be159
  ylying authored Jul 17, 2024
  
  fe3be159
- Fix model forward grad (#628) · c9ee3d35
  Liangsheng Yin authored Jul 15, 2024
  
  c9ee3d35
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
07 Jun, 2024 1 commit

Lianmin Zheng authored Jun 07, 2024


Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>

bf3e271f

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

21 May, 2024 1 commit
- Use model loader from vllm (#459) · 19d2135c
  Lianmin Zheng authored May 21, 2024
  
  19d2135c
14 May, 2024 1 commit
- [Feat] Add llava qwen, llava mistral (#419) · 664287b2
  Kaichen Zhang - NTU authored May 14, 2024
```
Co-authored-by: Bo Li <drluodian@gmail.com>
```
  664287b2
13 May, 2024 1 commit
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
11 Mar, 2024 1 commit
- replace skip_embed with input_embeds (#222) · 64fe3115
  Geary.Z authored Mar 11, 2024
  
  64fe3115
30 Jan, 2024 3 commits
- Update quick start examples (#120) · 06175286
  Lianmin Zheng authored Jan 30, 2024
  
  06175286
- Format code (#118) · 4ea92f83
  Lianmin Zheng authored Jan 29, 2024
  
  4ea92f83
- Add qwen2 (#114) · 6b0af285
  Junyang Lin authored Jan 30, 2024
  
  6b0af285
25 Jan, 2024 1 commit
- Dynamic model class loading (#101) · 3a581e99
  Cody Yu authored Jan 25, 2024
  
  3a581e99
23 Jan, 2024 1 commit
- Support load fine-tuned LLaVA model (#80) · e08bca28
  isaac-vidas authored Jan 22, 2024
  
  e08bca28
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081