Commits · 665e5e85f6d7a3a153d852cf11f73ba2f892fdff · change / sglang

24 Jan, 2025 3 commits
- Add step to update sgl-kernel whl index (#3110) · 665e5e85
  Ke Bao authored Jan 25, 2025
  
  665e5e85
- Add workflow for sgl-kernel cu118 release (#3109) · a22f60a3
  Ke Bao authored Jan 24, 2025
  
  a22f60a3
- [router] Fix twine uploading (#3095) · 3ed0a547
  Byron Hsu authored Jan 23, 2025
  
  3ed0a547
23 Jan, 2025 4 commits
- sync flashinfer and update sgl-kernel tests (#3081) · 0da0989a
  Yineng Zhang authored Jan 23, 2025
  
  0da0989a
- update version setup for sgl-kernel (#3079) · 3d0bfa3e
  Yineng Zhang authored Jan 23, 2025
  
  3d0bfa3e
- fix build error for sgl-kernel (#3078) · 1f6cf0d4
  Yineng Zhang authored Jan 23, 2025
  
  1f6cf0d4
- use v0.6.4.post1 for sgl-kernel ci (#3071) · 3e032c07
  Yineng Zhang authored Jan 23, 2025
  
  3e032c07
22 Jan, 2025 1 commit
- sync the upstream updates of flashinfer (#3051) · bcda0c9e
  Yineng Zhang authored Jan 22, 2025
  
  bcda0c9e
21 Jan, 2025 5 commits
- fix pr-test-sgl-kernel (#3036) · a42213db
  Yineng Zhang authored Jan 22, 2025
  
  a42213db
- feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) · 5a0d680a
  Yineng Zhang authored Jan 21, 2025
  
  5a0d680a
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
- upgrade torch version for sgl-kernel (#3026) · ec1c21cd
  Yineng Zhang authored Jan 21, 2025
  
  ec1c21cd
- minor: update Makefile for sgl-kernel (#3025) · 6c856b4f
  Yineng Zhang authored Jan 21, 2025
  
  6c856b4f
20 Jan, 2025 3 commits
- Add clang-format check to sgl-kernel ci (#3012) · 41a0ccd4
  Ke Bao authored Jan 20, 2025
  
  41a0ccd4
- Update TypeBasedDispatcher and balance CI tests (#3001) · 09bcbe01
  Lianmin Zheng authored Jan 19, 2025
  
  09bcbe01
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
19 Jan, 2025 2 commits
- [router] Fix sgl router path for release (#2980) · 4719c1d0
  Byron Hsu authored Jan 19, 2025
  
  4719c1d0
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
17 Jan, 2025 2 commits
- Fix sgl-kernel ci (#2938) · f3e9b489
  Ke Bao authored Jan 17, 2025
  
  f3e9b489
- Update release-docs.yml (#2937) · 6a7973ad
  Lianmin Zheng authored Jan 17, 2025
  
  6a7973ad
16 Jan, 2025 2 commits
- Update release-docker-amd.yml to run on amd docker runner. (#2927) · a883f079
  saienduri authored Jan 16, 2025
  
  a883f079
- Add CI for sgl-kernel (#2924) · 58f3f2b8
  Ke Bao authored Jan 17, 2025
  
  58f3f2b8
15 Jan, 2025 1 commit
- minor: update pr test (#2908) · 58f42b1d
  Yineng Zhang authored Jan 16, 2025
  
  58f42b1d
14 Jan, 2025 1 commit
- docs: update README (#2878) · 80002562
  Yineng Zhang authored Jan 14, 2025
  
  80002562
13 Jan, 2025 5 commits
- minor: fix release docs (#2868) · d855653b
  Yineng Zhang authored Jan 13, 2025
  
  d855653b
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
- minor: use ubuntu-latest instead of self-hosted runner for amd build (#2861) · 4536d724
  Yineng Zhang authored Jan 13, 2025
  
  4536d724
- fix: not delete CNAME (#2860) · 20a9f5df
  Yineng Zhang authored Jan 13, 2025
  
  20a9f5df
- fix sgl-kernel build (#2850) · a879c2fb
  Yineng Zhang authored Jan 13, 2025
  
  a879c2fb
07 Jan, 2025 1 commit
- Misc fix for min_p_sampling, --cuda-graph-bs (#2761) · bdc1acf6
  Lianmin Zheng authored Jan 07, 2025
  
  bdc1acf6
31 Dec, 2024 2 commits
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
30 Dec, 2024 1 commit
- [Docs] clean up structured outputs docs (#2654) · 8c3b420e
  Lianmin Zheng authored Dec 29, 2024
  
  8c3b420e
29 Dec, 2024 1 commit
- Update the timeout in nightly-test.yml (#2649) · b08c308e
  Lianmin Zheng authored Dec 29, 2024
  
  b08c308e
28 Dec, 2024 1 commit
- [CI] Fix nightly test and raise better error message (#2626) · 855d0ba3
  Lianmin Zheng authored Dec 27, 2024
```
Co-authored-by: Sangbin <rkooo567@gmail.com>
```
  855d0ba3
26 Dec, 2024 1 commit
- Fix test and benchmark scripts (#2598) · dc3bee48
  Lianmin Zheng authored Dec 26, 2024
  
  dc3bee48
21 Dec, 2024 1 commit
- chore: bump v0.4.0.post2 (#2525) · 8f4d04e5
  Yineng Zhang authored Dec 21, 2024
  
  8f4d04e5
17 Dec, 2024 1 commit
- Clean up GPU memory after killing sglang processes (#2457) · ce094a5d
  Ata Fatahi authored Dec 17, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  ce094a5d
16 Dec, 2024 1 commit
- minor: update flashinfer nightly (#2490) · 7154b4b1
  Yineng Zhang authored Dec 16, 2024
  
  7154b4b1
12 Dec, 2024 1 commit
- feat: support dev image (#2469) · f0ed9c35
  Yineng Zhang authored Dec 13, 2024
  
  f0ed9c35