Commits · 67008f4b320d8950803fcb14b1e5dc6e80bf75e4 · change / sglang

13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
07 Jan, 2025 1 commit
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
31 Dec, 2024 2 commits
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
26 Dec, 2024 1 commit
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
16 Dec, 2024 1 commit
- minor: update flashinfer nightly (#2490) · 7154b4b1
  Yineng Zhang authored Dec 16, 2024
  
  7154b4b1
06 Dec, 2024 1 commit
- Resubmit MoE-EP (#2371) · 3d32e4a3
  xiaobochen authored Dec 06, 2024
  
  3d32e4a3
02 Dec, 2024 1 commit
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3
01 Dec, 2024 3 commits
- Fix logprob for completions (#2301) · 5c18a037
  Lianmin Zheng authored Dec 01, 2024
  
  5c18a037
- minor: support flashinfer nightly (#2295) · fc78640e
  Yineng Zhang authored Dec 01, 2024
  
  fc78640e
- [CI] Balance CI tests (#2293) · 9449a954
  Lianmin Zheng authored Dec 01, 2024
  
  9449a954
30 Nov, 2024 1 commit
- Add get weights by parameter name for llama (#2266) · 7d1485d3
  Chayenne authored Nov 29, 2024
  
  7d1485d3
28 Nov, 2024 1 commit
- Fix memory leak during abort (#2238) · b2ccf36d
  Lianmin Zheng authored Nov 28, 2024
  
  b2ccf36d
26 Nov, 2024 1 commit
- Rename double sparsity config file (#2188) · ea34350d
  Lianmin Zheng authored Nov 25, 2024
  
  ea34350d
24 Nov, 2024 3 commits
- Balance CI tests (#2162) · fe5d3e81
  Lianmin Zheng authored Nov 24, 2024
  
  fe5d3e81
- Fix mixed chunked prefill in overlap mode (#2158) · 731146f6
  Lianmin Zheng authored Nov 24, 2024
  
  731146f6
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
22 Nov, 2024 1 commit
- Rename sglang.bench_latency to sglang.bench_one_batch (#2118) · dfec7fca
  Lianmin Zheng authored Nov 21, 2024
  
  dfec7fca
17 Nov, 2024 2 commits
- Revert "chore: update torch v2.5.1" (#2063) · c1f401fc
  Lianmin Zheng authored Nov 17, 2024
  
  c1f401fc
- chore: update torch v2.5.1 (#1849) · 3b878863
  Yineng Zhang authored Nov 18, 2024
  
  3b878863
16 Nov, 2024 1 commit
- Support DP MLA (#1970) · 976bc302
  Ke Bao authored Nov 16, 2024
  
  976bc302
12 Nov, 2024 1 commit
- Fix a typo in io_struct.py (#2008) · befc6beb
  Lianmin Zheng authored Nov 11, 2024
  
  befc6beb
10 Nov, 2024 2 commits
- [CI] Balance unit tests (#1988) · 3d043319
  Lianmin Zheng authored Nov 10, 2024
  
  3d043319
- [CI] balance unit tests (#1977) · 520f0094
  Lianmin Zheng authored Nov 09, 2024
  
  520f0094
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
01 Nov, 2024 1 commit
- Fix retraction + overlap (#1860) · b9fd178f
  Liangsheng Yin authored Oct 31, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  b9fd178f
31 Oct, 2024 1 commit
- Fix memory leak for chunked prefill 2 (#1858) · a2e0424a
  Lianmin Zheng authored Oct 31, 2024
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  a2e0424a
26 Oct, 2024 1 commit
- Update ci workflows (#1804) · 6aa94b96
  Lianmin Zheng authored Oct 26, 2024
  
  6aa94b96
25 Oct, 2024 1 commit
- Enhance the test case for chunked prefill (#1785) · 1701b0db
  Lianmin Zheng authored Oct 24, 2024
  
  1701b0db
20 Oct, 2024 1 commit

Support qwen2 vl model (#1721) · cbbc82b7

Yineng Zhang authored Oct 19, 2024


Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ispobock <ISPObaoke@163.com>

cbbc82b7

17 Oct, 2024 2 commits
- Fix mixed batch for multi modal models (#1702) · d17d19e5
  Lianmin Zheng authored Oct 17, 2024
  
  d17d19e5
- Update the transformers version in CI (#1690) · 02f7f3e4
  Lianmin Zheng authored Oct 16, 2024
  
  02f7f3e4
14 Oct, 2024 1 commit
- Fix unit test order to balance the tasks in CI (#1665) · 6790240c
  Lianmin Zheng authored Oct 14, 2024
  
  6790240c
12 Oct, 2024 1 commit
- Fix unit tests and type annotations (#1648) · 69aa937a
  Lianmin Zheng authored Oct 12, 2024
  
  69aa937a
11 Oct, 2024 2 commits
- Release v0.3.3.post1 (#1636) · 00c7e636
  Lianmin Zheng authored Oct 11, 2024
  
  00c7e636
- Add back data parallelism (#1635) · 23cc66f7
  Lianmin Zheng authored Oct 11, 2024
  
  23cc66f7
04 Oct, 2024 1 commit
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
29 Sep, 2024 1 commit
- Improve process creation (#1534) · 04868543
  Lianmin Zheng authored Sep 29, 2024
  
  04868543
28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d