Commits · 2c3ea294762bef38ce6bd719d3739b4a6b71bcb6 · change / sglang

29 Apr, 2025 1 commit
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 4 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
27 Apr, 2025 1 commit
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
22 Apr, 2025 1 commit
- chore: bump v0.4.5.post3 (#5611) · b9c87e78
  Yineng Zhang authored Apr 21, 2025
  
  b9c87e78
21 Apr, 2025 1 commit
- Perform Batch Tokenization. (#5141) · f0815419
  Sundara Raman Ramachandran authored Apr 20, 2025
  
  f0815419
20 Apr, 2025 2 commits
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
- Minor update for ROCm variable style (#5562) · c555d794
  Zhaoyi Li authored Apr 20, 2025
  
  c555d794
15 Apr, 2025 1 commit
- Add A800 shared experts fused MoE kernel tuning configs for DeepSeek V3/R1 (#5368) · 61e7c4dd
  lambert0312 authored Apr 15, 2025
  
  61e7c4dd
12 Apr, 2025 2 commits
- refine fused_moe tuning docs (#5294) · 3e4794aa
  Xiaoyu Zhang authored Apr 13, 2025
  
  3e4794aa
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
08 Apr, 2025 1 commit
- [FA3 Feature] Support multi modal Llama-3.2-11B-Vision-Instruct (#5103) · a7c3f74b
  Chunan Zeng authored Apr 07, 2025
  
  a7c3f74b
04 Apr, 2025 2 commits
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
- [2/3] fix dsv3 awq issue (#4625) · d95269f9
  AniZpZ authored Apr 04, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
```
  d95269f9
03 Apr, 2025 1 commit
- Add LlavaLlamaForCausaLM in MultiModal Processors (#5039) · 69df9761
  Ravi Theja authored Apr 04, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  69df9761
31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
28 Mar, 2025 1 commit
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
27 Mar, 2025 2 commits
- Basic Cleanup (#4833) · 98a2cfa9
  Daniel Holanda authored Mar 27, 2025
  
  98a2cfa9
- Update MMMU Benchmark instructions (#4694) · e6e4d022
  Ravi Theja authored Mar 28, 2025
  
  e6e4d022
25 Mar, 2025 2 commits
- [Benchmark] tilelang vs deepgemm vs w8a8_block_fp8_matmul (#4735) · 14269198
  Chunan Zeng authored Mar 24, 2025
  
  14269198
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
24 Mar, 2025 1 commit
- rename benchmark_deepgemm_fp8_group_gemm.py (#4605) · 3980ff1b
  Tongbao Zhang authored Mar 24, 2025
  
  3980ff1b
23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
22 Mar, 2025 2 commits
- Add EAGLE mtbench benchmark script (#4676) · 8f163b16
  Ke Bao authored Mar 23, 2025
```
Co-authored-by: chromecast56 <jamesll@mit.edu>
```
  8f163b16
- Correcting default configuration when benchmarking fused_moe (#4665) · 38f25e87
  penguin_wwy authored Mar 22, 2025
  
  38f25e87
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
18 Mar, 2025 1 commit
- refactor: rewrite bench-mmmu-sglang (#4458) · 98be3bd3
  Mick authored Mar 18, 2025
  
  98be3bd3
17 Mar, 2025 2 commits
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
- Benchmark: Statistical Analysis of the Output Stability of the Deepseek Model (#4202) · 402db5c5
  ZelinTan authored Mar 17, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  402db5c5
16 Mar, 2025 1 commit
- [Fix] use `torch.cat` instead of `torch.concat` to prevent entering the... · 1a3fa75f
  JieXin Liang authored Mar 16, 2025
```
[Fix] use `torch.cat` instead of `torch.concat` to prevent entering the `Autograd` backends. (#4466)
```
  1a3fa75f
14 Mar, 2025 1 commit
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
13 Mar, 2025 1 commit
- add INT8 example into dsv3 README (#4079) · 0c020860
  laixin authored Mar 13, 2025
  
  0c020860
12 Mar, 2025 2 commits
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
- refine sgl_moe_align_block_size_benchmark (#4327) · 7130a7ce
  Xiaoyu Zhang authored Mar 12, 2025
  
  7130a7ce
11 Mar, 2025 2 commits
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
- Add A100 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4287) · 6a02b32d
  yych0745 authored Mar 11, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  6a02b32d