Commits · 588865f0e06bc852878b2a294666f26e0b837ccb · change / sglang

19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
18 Mar, 2025 1 commit
- use sgl custom all reduce (#4441) · c7872985
  Yineng Zhang authored Mar 18, 2025
  
  c7872985
17 Mar, 2025 1 commit
- Fix data parallel + tensor parallel (#4499) · 5493c334
  Lianmin Zheng authored Mar 17, 2025
  
  5493c334
16 Mar, 2025 2 commits
- Remove filter for pr-tests (#4468) · 06d12b39
  Lianmin Zheng authored Mar 16, 2025
  
  06d12b39
- Fix finish step for pr tests and notebook tests (#4467) · c30976fb
  Lianmin Zheng authored Mar 16, 2025
  
  c30976fb
14 Mar, 2025 1 commit
- use topk_softmax with sgl-kernel (#4439) · ad1ae7f7
  Yineng Zhang authored Mar 14, 2025
  
  ad1ae7f7
13 Mar, 2025 1 commit
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
10 Mar, 2025 3 commits
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
08 Mar, 2025 1 commit
- Test no vllm custom allreduce (#4210) · 2cadd51d
  Lianmin Zheng authored Mar 08, 2025
  
  2cadd51d
06 Mar, 2025 1 commit

Fix a draft model accuracy bug in eagle; support step=1; return logprob in eagle (#4134) · bc1534ff

Lianmin Zheng authored Mar 06, 2025


Co-authored-by: Sehoon Kim <kssteven418@gmail.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

bc1534ff

02 Mar, 2025 1 commit
- Add accuracy test for TP torch compile (#3994) · d3fe9bae
  Ke Bao authored Mar 03, 2025
  
  d3fe9bae
28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
25 Feb, 2025 1 commit
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
18 Feb, 2025 1 commit
- update pr-test (#3663) · f983213a
  Yineng Zhang authored Feb 18, 2025
  
  f983213a
17 Feb, 2025 1 commit
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
15 Feb, 2025 1 commit
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
14 Feb, 2025 1 commit
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
07 Feb, 2025 2 commits
- update pr-test ci (#3376) · 5da3d21c
  Yineng Zhang authored Feb 07, 2025
  
  5da3d21c
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
04 Feb, 2025 1 commit
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
27 Jan, 2025 1 commit
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
26 Jan, 2025 3 commits
- Do not load OPENAI_KEY from secrets (#3147) · 4a612531
  Lianmin Zheng authored Jan 26, 2025
  
  4a612531
- Fix repetition penalty (#3139) · 4f118a39
  Lianmin Zheng authored Jan 25, 2025
  
  4f118a39
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
20 Jan, 2025 2 commits
- Update TypeBasedDispatcher and balance CI tests (#3001) · 09bcbe01
  Lianmin Zheng authored Jan 19, 2025
  
  09bcbe01
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
15 Jan, 2025 1 commit
- minor: update pr test (#2908) · 58f42b1d
  Yineng Zhang authored Jan 16, 2025
  
  58f42b1d
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
07 Jan, 2025 1 commit
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
31 Dec, 2024 2 commits
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
26 Dec, 2024 1 commit
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
16 Dec, 2024 1 commit
- minor: update flashinfer nightly (#2490) · 7154b4b1
  Yineng Zhang authored Dec 16, 2024
  
  7154b4b1
06 Dec, 2024 1 commit
- Resubmit MoE-EP (#2371) · 3d32e4a3
  xiaobochen authored Dec 06, 2024
  
  3d32e4a3
02 Dec, 2024 1 commit
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3