Commits · fa82dfccdd1d2b45ae9fda53e1f436d6c4dce2ae · change / sglang · GitLab

07 Feb, 2025 11 commits
- fix EagleVerifyInput (#3378) · fa82dfcc
  Yineng Zhang authored Feb 07, 2025
  
  fa82dfcc
- update pr-test ci (#3376) · 5da3d21c
  Yineng Zhang authored Feb 07, 2025
  
  5da3d21c
- update sgl-kernel version (#3374) · f2870376
  Yineng Zhang authored Feb 07, 2025
  
  f2870376
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
- update waves_per_eu to 1 (#3356) · e868d0b6
  lizamd authored Feb 06, 2025
  
  e868d0b6
- Fix: Runtime error for function calling (#3300) · 591e751e
  Shi Shuai authored Feb 07, 2025
  
  591e751e
- Feature: Fix the binding error in Llama (#3355) · 40022d07
  Chayenne authored Feb 06, 2025
  
  40022d07
- Docs: Add deepseek usage and add multi-node, credit to lycanlancelot (#3314) · 823148e7
  Liangjun Song authored Feb 07, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  823148e7
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
06 Feb, 2025 9 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- fix sgl-kernel build failure on AMD (#3352) · adeee152
  Yineng Zhang authored Feb 07, 2025
  
  adeee152
- [Doc] Add optimization option guide for deepseek v3 (#3349) · 6792411e
  Ke Bao authored Feb 06, 2025
  
  6792411e
- add AMD guide for DeepSeek-R1 (#3338) · 7348d962
  Yineng Zhang authored Feb 06, 2025
  
  7348d962
- update pull request template (#3337) · 25ed22b6
  Yineng Zhang authored Feb 06, 2025
  
  25ed22b6
- Add sgl-kernel to MI300 CI paths tested. (#3335) · 200d3b16
  saienduri authored Feb 06, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  200d3b16
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
- [ROCm] Fix fp8 unrolledx4 matmul kernel. (#3325) · 32de54ed
  Wen-Heng (Jack) Chung authored Feb 05, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  32de54ed
- Docker switch (#3327) · 2d9c3195
  saienduri authored Feb 05, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  2d9c3195
05 Feb, 2025 8 commits
- update README (#3324) · 07e58a2d
  Yineng Zhang authored Feb 06, 2025
  
  07e58a2d
- Initial Enablement of CI on MI300 (#3168) · 04d8cd20
  saienduri authored Feb 05, 2025
  
  04d8cd20
- Support custom mask for Triton attention (#3317) · a322051e
  Ke Bao authored Feb 06, 2025
  
  a322051e
- Update Triton extend backend interface (#3309) · de553334
  Ke Bao authored Feb 05, 2025
  
  de553334
- chore: bump v0.4.2.post2 (#3313) · 7aad8d18
  Yineng Zhang authored Feb 05, 2025
  
  7aad8d18
- Fix lora flashinfer import bug on ROCM (#3312) · 76fa2d15
  Baizhou Zhang authored Feb 05, 2025
  
  76fa2d15
- [ROCm] Logic to decide whether to used manually unrolled kernel. (#3306) · 7ab84948
  Wen-Heng (Jack) Chung authored Feb 04, 2025
  
  7ab84948
- Use forward_cuda to execute custom op for hip platform (#3305) · 4885b908
  kk authored Feb 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  4885b908
04 Feb, 2025 7 commits
- [ROCm] Manually unroll _w8a8_block_fp8_matmul kernel on AMD GPU. (#3299) · c2723a42
  Wen-Heng (Jack) Chung authored Feb 04, 2025
  
  c2723a42
- [ROCm] Add tuning configs for AMD Radeon Graphics. (#3294) · c7256ca8
  Wen-Heng (Jack) Chung authored Feb 04, 2025
  
  c7256ca8
- update flashinfer install index url (#3293) · 6186a8f8
  Yineng Zhang authored Feb 05, 2025
  
  6186a8f8
- Update Triton decode backend interface (#3292) · a07364cc
  Ke Bao authored Feb 04, 2025
  
  a07364cc
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
03 Feb, 2025 5 commits
- Update server args doc (#3273) · 7b5a3741
  simveit authored Feb 04, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
```
  7b5a3741
- add Atlas Cloud for Adoption and Sponsorship (#3276) · 4b6f62e2
  Yineng Zhang authored Feb 04, 2025
  
  4b6f62e2
- add Nebius for Adoption and Sponsorship (#3274) · 897e2e25
  Yineng Zhang authored Feb 04, 2025
  
  897e2e25
- adding Triton configs for DeepSeekV3 on Blackwell (#3272) · d54cee14
  kushanam authored Feb 03, 2025
  
  d54cee14
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04