Commits · 5ad296bda140117e4eb85ce781955d94fb221973 · change / sglang · GitLab

29 Aug, 2025 1 commit
- Optimize prefill performance on cpu backend (#8750) · 5ad296bd
  Ma Mingfei authored Aug 29, 2025
  
  5ad296bd
05 Aug, 2025 1 commit
- [CPU][sgl-kernel] biased_grouped_topk: fix correction_bias dtype to float32 (#8212) · 08f8f490
  Chunyuan WU authored Aug 05, 2025
```
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
```
  08f8f490
01 Aug, 2025 1 commit
- Fix FP8 block quantization when N or K is not multiples of 128 (#8648) · 1fe691a4
  YanbingJiang authored Aug 02, 2025
  
  1fe691a4
09 Jul, 2025 2 commits
- [CPU] [FP8] set SGLANG_CPU_FP8_CVT_FTZ in CMakeLists.txt (#7885) · ac80f4da
  Chunyuan WU authored Jul 09, 2025
  
  ac80f4da
- [CPU]convert topk_weights to fp32 for INT8 and FP8 paths (for llama4) and fix... · 128f16a8
  Chunyuan WU authored Jul 09, 2025
```
[CPU]convert topk_weights to fp32 for INT8 and FP8 paths (for llama4) and fix LmHead weight pack (#7818)
```
  128f16a8
03 Jul, 2025 2 commits
- [CPU] [sgl-kernel] set dispatch key of initialize to CatchAll (#7734) · 36cc3ffd
  Chunyuan WU authored Jul 03, 2025
  
  36cc3ffd
- Support non-contiguous query input for extend/decode attention (#7462) · b044400d
  YanbingJiang authored Jul 03, 2025
  
  b044400d
01 Jul, 2025 1 commit
- [CPU] remove process_group from inputs of shm_allreduce and shm_allgather (#7486) · 6005ecee
  Chunyuan WU authored Jul 01, 2025
  
  6005ecee
30 Jun, 2025 1 commit
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
25 Jun, 2025 1 commit

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel... · 7eb47b0f

Chunyuan WU authored Jun 25, 2025


[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>

7eb47b0f

10 Jun, 2025 1 commit
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
03 Jun, 2025 1 commit
- Add CPU optimized kernels for topk and rope fusions (#6456) · ff00895c
  jianan-gu authored Jun 03, 2025
  
  ff00895c
23 May, 2025 2 commits
- Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404) · 3ded6235
  Chunyuan WU authored May 23, 2025
  
  3ded6235
- Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493) · 4ba1eea8
  blzheng authored May 23, 2025
  
  4ba1eea8
21 May, 2025 1 commit
- [CPU] Fix build issue (#6419) · cfe48c59
  blzheng authored May 22, 2025
  
  cfe48c59
20 May, 2025 1 commit
- Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405) · 32cc66ef
  YanbingJiang authored May 20, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  32cc66ef
18 May, 2025 1 commit
- Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339) · 5dd62c3a
  Chunyuan WU authored May 19, 2025
```
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  5dd62c3a
15 May, 2025 1 commit
- Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
  Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fb4959b2
13 May, 2025 1 commit
- [CPU] Add CMakeLists.txt for sgl-kernel (#6115) · 0f75b907
  blzheng authored May 14, 2025
  
  0f75b907
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 Apr, 2025 1 commit

Add optimized native kernels in sgl-kernel (#5150) · a73c4df4

Ma Mingfei authored Apr 09, 2025


Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: blzheng <beilei.zheng@intel.com>

a73c4df4