Commits · ad1ae7f7cd0e735599eae7ca58266b17eb38b385 · change / sglang

14 Mar, 2025 1 commit
- use topk_softmax with sgl-kernel (#4439) · ad1ae7f7
  Yineng Zhang authored Mar 14, 2025
  
  ad1ae7f7
13 Mar, 2025 1 commit
- Fix auto merge & add back get_flat_data_by_layer (#4393) · a5a892ff
  Lianmin Zheng authored Mar 13, 2025
  
  a5a892ff
10 Mar, 2025 3 commits
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
08 Mar, 2025 1 commit
- Test no vllm custom allreduce (#4210) · 2cadd51d
  Lianmin Zheng authored Mar 08, 2025
  
  2cadd51d
06 Mar, 2025 1 commit

Fix a draft model accuracy bug in eagle; support step=1; return logprob in eagle (#4134) · bc1534ff

Lianmin Zheng authored Mar 06, 2025


Co-authored-by: Sehoon Kim <kssteven418@gmail.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

bc1534ff

02 Mar, 2025 1 commit
- Add accuracy test for TP torch compile (#3994) · d3fe9bae
  Ke Bao authored Mar 03, 2025
  
  d3fe9bae
28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
25 Feb, 2025 1 commit
- Fix CI and install docs (#3821) · d7934cde
  Lianmin Zheng authored Feb 24, 2025
  
  d7934cde
18 Feb, 2025 1 commit
- update pr-test (#3663) · f983213a
  Yineng Zhang authored Feb 18, 2025
  
  f983213a
17 Feb, 2025 1 commit
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
15 Feb, 2025 1 commit
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
14 Feb, 2025 1 commit
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
07 Feb, 2025 2 commits
- update pr-test ci (#3376) · 5da3d21c
  Yineng Zhang authored Feb 07, 2025
  
  5da3d21c
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
04 Feb, 2025 1 commit
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
27 Jan, 2025 1 commit
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
26 Jan, 2025 3 commits
- Do not load OPENAI_KEY from secrets (#3147) · 4a612531
  Lianmin Zheng authored Jan 26, 2025
  
  4a612531
- Fix repetition penalty (#3139) · 4f118a39
  Lianmin Zheng authored Jan 25, 2025
  
  4f118a39
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
20 Jan, 2025 2 commits
- Update TypeBasedDispatcher and balance CI tests (#3001) · 09bcbe01
  Lianmin Zheng authored Jan 19, 2025
  
  09bcbe01
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
15 Jan, 2025 1 commit
- minor: update pr test (#2908) · 58f42b1d
  Yineng Zhang authored Jan 16, 2025
  
  58f42b1d
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
07 Jan, 2025 1 commit
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
31 Dec, 2024 2 commits
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
26 Dec, 2024 1 commit
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
16 Dec, 2024 1 commit
- minor: update flashinfer nightly (#2490) · 7154b4b1
  Yineng Zhang authored Dec 16, 2024
  
  7154b4b1
06 Dec, 2024 1 commit
- Resubmit MoE-EP (#2371) · 3d32e4a3
  xiaobochen authored Dec 06, 2024
  
  3d32e4a3
02 Dec, 2024 1 commit
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3
01 Dec, 2024 3 commits
- Fix logprob for completions (#2301) · 5c18a037
  Lianmin Zheng authored Dec 01, 2024
  
  5c18a037
- minor: support flashinfer nightly (#2295) · fc78640e
  Yineng Zhang authored Dec 01, 2024
  
  fc78640e
- [CI] Balance CI tests (#2293) · 9449a954
  Lianmin Zheng authored Dec 01, 2024
  
  9449a954
30 Nov, 2024 1 commit
- Add get weights by parameter name for llama (#2266) · 7d1485d3
  Chayenne authored Nov 29, 2024
  
  7d1485d3
28 Nov, 2024 1 commit
- Fix memory leak during abort (#2238) · b2ccf36d
  Lianmin Zheng authored Nov 28, 2024
  
  b2ccf36d