Commits · 9490d1577279b1cb4fafe291edfac7e55f9918b3 · change / sglang

11 Feb, 2025 6 commits
- fix supported_models Qwen typo (#3498) · 9490d157
  Didier Durand authored Feb 11, 2025
  
  9490d157
- fix deepseek_v3 typo (#3497) · eefcbdd3
  Didier Durand authored Feb 11, 2025
  
  eefcbdd3
- Support Eagle cuda graph for Triton backend (#3500) · 7e6d5fc6
  Ke Bao authored Feb 12, 2025
  
  7e6d5fc6
- Tune MI300X fused MoE Triton kernel JSON config. (#3492) · cadd5dbe
  Wen-Heng (Jack) Chung authored Feb 11, 2025
  
  cadd5dbe
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
- [ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418) · fdf04a14
  yigex authored Feb 11, 2025
```
Co-authored-by: Bruce Xue <yigex@xilinx.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  fdf04a14
10 Feb, 2025 10 commits
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
- refine some typo (#3473) · 2f47d710
  Xiaoyu Zhang authored Feb 10, 2025
  
  2f47d710
- fix mla test (#3469) · 4fe92bfc
  Yineng Zhang authored Feb 10, 2025
  
  4fe92bfc
- [Eagle] reduce one draft forward (#3468) · d23cb9a0
  Ying Sheng authored Feb 10, 2025
  
  d23cb9a0
- Support Eagle2 for Triton backend (#3466) · 2d611323
  Ke Bao authored Feb 10, 2025
  
  2d611323
- chore: bump v0.4.2.post4 (#3459) · cddb1cdf
  Yineng Zhang authored Feb 10, 2025
  
  cddb1cdf
- use nvcr.io/nvidia/tritonserver:24.04-py3-min as base image (#3457) · fa1b40e0
  Yineng Zhang authored Feb 10, 2025
  
  fa1b40e0
- [Fix] Fix accuracy bug and refactor codes for lora (#3413) · c45cab1c
  Baizhou Zhang authored Feb 09, 2025
  
  c45cab1c
- remove _grouped_size_compiled_for_decode_kernels (#3453) · 27c4c9cf
  Yineng Zhang authored Feb 10, 2025
  
  27c4c9cf
- Update contribution_guide.md (#3452) · 52a492a1
  Ying Sheng authored Feb 09, 2025
  
  52a492a1
09 Feb, 2025 17 commits
- feat: enable ragged fa3 by default on hopper 12.4+ (#3442) · 36f6fc50
  Yineng Zhang authored Feb 10, 2025
  
  36f6fc50
- fix ci (#3441) · d8727275
  Yineng Zhang authored Feb 10, 2025
  
  d8727275
- chore: bump sgl-kernel v0.0.3.post3 (#3440) · 6239d0b2
  Yineng Zhang authored Feb 10, 2025
  
  6239d0b2
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
- [docs] Update quantization documentation (#3437) · 20cf910d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: jamessand <shazhizhou0@gmail.com>
```
  20cf910d
- [Docs] Add quantization docs (#3410) · 0af1d239
  Wenxuan Tan authored Feb 09, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  0af1d239
- compatible with new outlines (#3435) · 85986bb9
  Yineng Zhang authored Feb 10, 2025
  
  85986bb9
- remove activation dependency in fused_moe (#3433) · 64c87135
  Yineng Zhang authored Feb 10, 2025
  
  64c87135
- fix draft cuda graph capture failure (#3431) · 1646149a
  Yineng Zhang authored Feb 09, 2025
  
  1646149a
- add cuda graph capture failure possible solution (#3430) · bc72e5bd
  Yineng Zhang authored Feb 09, 2025
  
  bc72e5bd
- update forward_return_lse (#3425) · 014cab4d
  Yineng Zhang authored Feb 09, 2025
  
  014cab4d
- remove cutex dependency (#3422) · 4d2dbeac
  Yineng Zhang authored Feb 09, 2025
  
  4d2dbeac
- fix cu118 link issue (#3421) · 29daf498
  Yineng Zhang authored Feb 09, 2025
  
  29daf498
- [docs] Add multi-node inference example for SLURM in documentation (#3408) · 6702592d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: aflah02 <aflah20082@iiitd.ac.in>
```
  6702592d
- minor: cleanup test_eagle_infer (#3415) · 60abdb3e
  Yineng Zhang authored Feb 09, 2025
  
  60abdb3e
- [Fix] Fix eagle with disable cuda graph (#3411) · 7b4e61ff
  Ying Sheng authored Feb 08, 2025
  
  7b4e61ff
- add disable cuda graph unit test for eagle 2 (#3412) · 6222e1c2
  Yineng Zhang authored Feb 09, 2025
  
  6222e1c2
08 Feb, 2025 6 commits
- fix EAGLE 2 non greedy case (#3407) · fad315cb
  Yineng Zhang authored Feb 09, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fad315cb
- fix typo · f90db8bc
  Yineng Zhang authored Feb 08, 2025
  
  f90db8bc
- Add deepseek-v3 a100 serving example (#3404) · d8ad5970
  Ke Bao authored Feb 08, 2025
  
  d8ad5970
- Update fused_moe's benchmark (#3346) · 849f58d6
  GaoYuYang authored Feb 08, 2025
  
  849f58d6
- [BUG] fix moe benchmark when bs*seq is small (#3382) · 64480df4
  yiakwy-xpu-ml-framework-team authored Feb 08, 2025
  
  64480df4
- Add H20 fp8 w8a8 gemm config (#3386) · 4530136e
  lukec authored Feb 08, 2025
  
  4530136e
07 Feb, 2025 1 commit

added amd_configure.md to references (#3275) · 0a6f18f0

Zachary Streeter authored Feb 07, 2025


Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

0a6f18f0