Commits · 2add697d7a5f685d029db275de0cbea09878dfd5 · change / sglang

18 Jan, 2025 1 commit
- feat: remove vllm get_rope (#2964) · 2add697d
  Yineng Zhang authored Jan 18, 2025
  
  2add697d
17 Jan, 2025 1 commit
- feat: remove vllm distributed (#2907) · 5dc54f1a
  Yineng Zhang authored Jan 17, 2025
```
Co-authored-by: Zhangyi <1109276519@qq.com>
```
  5dc54f1a
06 Dec, 2024 1 commit
- Add more support for intel Gaudi accelerators (#2357) · 37ee906f
  Qun Yang authored Dec 06, 2024
  
  37ee906f
02 Dec, 2024 1 commit
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
01 Dec, 2024 2 commits
- Revert "Revert "[FEAT] Support GGUF format"" (#2287) · 4936be8a
  Lianmin Zheng authored Nov 30, 2024
  
  4936be8a
- Revert "[FEAT] Support GGUF format" (#2285) · 7e4c6dd8
  Lianmin Zheng authored Nov 30, 2024
  
  7e4c6dd8
30 Nov, 2024 1 commit
- [FEAT] Support GGUF format (#2215) · 883c9554
  Yang Zheng authored Nov 30, 2024
```
Co-authored-by: Yang Zheng(SW)(Alex) <you@example.com>
```
  883c9554
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
01 Nov, 2024 1 commit
- Update vocab embedding deps and add TP switch (#1856) · 16eb33ff
  Ke Bao authored Nov 01, 2024
  
  16eb33ff
14 Oct, 2024 1 commit
- [1/N] Remove `CacheConfig` import in all model files (#1658) · 56503d9b
  Byron Hsu authored Oct 14, 2024
  
  56503d9b
30 Sep, 2024 1 commit
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc
19 Sep, 2024 1 commit
- feat: update linear deps 1/N (#1305) · b4408b0d
  Yineng Zhang authored Sep 19, 2024
  
  b4408b0d
14 Sep, 2024 1 commit
- Optimize conflicts between CUDA graph and vocab mask tensors (#1392) · 70b68029
  Liangsheng Yin authored Sep 13, 2024
  
  70b68029
29 Aug, 2024 1 commit
- Sampler cudagraph (#1253) · 381dd57b
  Liangsheng Yin authored Aug 28, 2024
  
  381dd57b
28 Aug, 2024 1 commit
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
26 Aug, 2024 1 commit
- Move sampler into CUDA graph (#1201) · 75ce37f4
  Liangsheng Yin authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  75ce37f4
12 Aug, 2024 1 commit
- feat: replace all rmsnorm and silu (#1057) · 6a38efa8
  Yineng Zhang authored Aug 13, 2024
  
  6a38efa8
07 Aug, 2024 1 commit
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
07 Jun, 2024 1 commit

Lianmin Zheng authored Jun 07, 2024


Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>

bf3e271f

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

21 May, 2024 1 commit
- Use model loader from vllm (#459) · 19d2135c
  Lianmin Zheng authored May 21, 2024
  
  19d2135c
13 May, 2024 1 commit
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
16 Apr, 2024 2 commits
- Fix commandr import; format code · 65501a9c
  Lianmin Zheng authored Apr 16, 2024
  
  65501a9c
- support `command-r` (#369) · db611066
  ZhouXingg authored Apr 17, 2024
  
  db611066