Commits · 70f894b810c0280763f2bc3e16927e10fe96f661 · change / sglang

14 Feb, 2025 1 commit
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
10 Feb, 2025 2 commits
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
- fix mla test (#3469) · 4fe92bfc
  Yineng Zhang authored Feb 10, 2025
  
  4fe92bfc
09 Feb, 2025 2 commits
- fix ci (#3441) · d8727275
  Yineng Zhang authored Feb 10, 2025
  
  d8727275
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
07 Feb, 2025 3 commits
- update pr-test ci (#3376) · 5da3d21c
  Yineng Zhang authored Feb 07, 2025
  
  5da3d21c
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
06 Feb, 2025 2 commits
- Add sgl-kernel to MI300 CI paths tested. (#3335) · 200d3b16
  saienduri authored Feb 06, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  200d3b16
- Docker switch (#3327) · 2d9c3195
  saienduri authored Feb 05, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  2d9c3195
05 Feb, 2025 1 commit
- Initial Enablement of CI on MI300 (#3168) · 04d8cd20
  saienduri authored Feb 05, 2025
  
  04d8cd20
04 Feb, 2025 1 commit
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
02 Feb, 2025 1 commit
- ROCm: bump 6.3.0 (#3259) · 566d61d9
  HAI authored Feb 02, 2025
  
  566d61d9
31 Jan, 2025 1 commit
- support 12.5 CUDA runtime (#3231) · b49d6d0f
  Yineng Zhang authored Jan 31, 2025
  
  b49d6d0f
28 Jan, 2025 1 commit

Docs fix about EAGLE and streaming output (#3166) · 7b9b4f44

Jhin authored Jan 27, 2025


Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>

7b9b4f44

27 Jan, 2025 1 commit
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
26 Jan, 2025 5 commits
- use self-hosted to build sgl-kernel (#3154) · f265d15b
  Yineng Zhang authored Jan 26, 2025
  
  f265d15b
- Do not load OPENAI_KEY from secrets (#3147) · 4a612531
  Lianmin Zheng authored Jan 26, 2025
  
  4a612531
- Fix repetition penalty (#3139) · 4f118a39
  Lianmin Zheng authored Jan 25, 2025
  
  4f118a39
- feat: cross python wheel for sgl-kernel (#3138) · 822bae8c
  Yineng Zhang authored Jan 26, 2025
  
  822bae8c
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
25 Jan, 2025 3 commits
- update installation doc for sgl-kernel (#3129) · 896c0744
  Yineng Zhang authored Jan 26, 2025
  
  896c0744
- Update tag name for whl release (#3127) · 67ad4338
  Ke Bao authored Jan 25, 2025
  
  67ad4338
- speedup pr test for sgl-kernel (#3126) · 3cab5f71
  Yineng Zhang authored Jan 25, 2025
  
  3cab5f71
24 Jan, 2025 3 commits
- Add step to update sgl-kernel whl index (#3110) · 665e5e85
  Ke Bao authored Jan 25, 2025
  
  665e5e85
- Add workflow for sgl-kernel cu118 release (#3109) · a22f60a3
  Ke Bao authored Jan 24, 2025
  
  a22f60a3
- [router] Fix twine uploading (#3095) · 3ed0a547
  Byron Hsu authored Jan 23, 2025
  
  3ed0a547
23 Jan, 2025 4 commits
- sync flashinfer and update sgl-kernel tests (#3081) · 0da0989a
  Yineng Zhang authored Jan 23, 2025
  
  0da0989a
- update version setup for sgl-kernel (#3079) · 3d0bfa3e
  Yineng Zhang authored Jan 23, 2025
  
  3d0bfa3e
- fix build error for sgl-kernel (#3078) · 1f6cf0d4
  Yineng Zhang authored Jan 23, 2025
  
  1f6cf0d4
- use v0.6.4.post1 for sgl-kernel ci (#3071) · 3e032c07
  Yineng Zhang authored Jan 23, 2025
  
  3e032c07
22 Jan, 2025 1 commit
- sync the upstream updates of flashinfer (#3051) · bcda0c9e
  Yineng Zhang authored Jan 22, 2025
  
  bcda0c9e
21 Jan, 2025 5 commits
- fix pr-test-sgl-kernel (#3036) · a42213db
  Yineng Zhang authored Jan 22, 2025
  
  a42213db
- feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) · 5a0d680a
  Yineng Zhang authored Jan 21, 2025
  
  5a0d680a
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
- upgrade torch version for sgl-kernel (#3026) · ec1c21cd
  Yineng Zhang authored Jan 21, 2025
  
  ec1c21cd
- minor: update Makefile for sgl-kernel (#3025) · 6c856b4f
  Yineng Zhang authored Jan 21, 2025
  
  6c856b4f
20 Jan, 2025 3 commits
- Add clang-format check to sgl-kernel ci (#3012) · 41a0ccd4
  Ke Bao authored Jan 20, 2025
  
  41a0ccd4
- Update TypeBasedDispatcher and balance CI tests (#3001) · 09bcbe01
  Lianmin Zheng authored Jan 19, 2025
  
  09bcbe01
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a