Commits · 6e2da5156176ed2d7fe2445b7c7316bc1650b20a · change / sglang

11 May, 2025 2 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
02 May, 2025 2 commits
- Support MMMU benchmark for InternVL (#5968) · 6ea1e6ac
  XinyuanTong authored May 02, 2025
  
  6ea1e6ac
- feat: add concurrency evaluation logic in mmmu benchmark (#5782) · c5645e92
  XinyuanTong authored May 01, 2025
  
  c5645e92
01 May, 2025 1 commit
- chore: bump v0.4.6.post2 (#5939) · 9858113c
  Yineng Zhang authored Apr 30, 2025
  
  9858113c
30 Apr, 2025 1 commit
- support vlm benchmark profile (#5905) · d50e36a7
  Yi Zhang authored Apr 30, 2025
  
  d50e36a7
29 Apr, 2025 2 commits
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 4 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
27 Apr, 2025 1 commit
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
22 Apr, 2025 1 commit
- chore: bump v0.4.5.post3 (#5611) · b9c87e78
  Yineng Zhang authored Apr 21, 2025
  
  b9c87e78
21 Apr, 2025 1 commit
- Perform Batch Tokenization. (#5141) · f0815419
  Sundara Raman Ramachandran authored Apr 20, 2025
  
  f0815419
20 Apr, 2025 2 commits
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
- Minor update for ROCm variable style (#5562) · c555d794
  Zhaoyi Li authored Apr 20, 2025
  
  c555d794
15 Apr, 2025 1 commit
- Add A800 shared experts fused MoE kernel tuning configs for DeepSeek V3/R1 (#5368) · 61e7c4dd
  lambert0312 authored Apr 15, 2025
  
  61e7c4dd
12 Apr, 2025 2 commits
- refine fused_moe tuning docs (#5294) · 3e4794aa
  Xiaoyu Zhang authored Apr 13, 2025
  
  3e4794aa
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
08 Apr, 2025 1 commit
- [FA3 Feature] Support multi modal Llama-3.2-11B-Vision-Instruct (#5103) · a7c3f74b
  Chunan Zeng authored Apr 07, 2025
  
  a7c3f74b
04 Apr, 2025 2 commits
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
- [2/3] fix dsv3 awq issue (#4625) · d95269f9
  AniZpZ authored Apr 04, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
```
  d95269f9
03 Apr, 2025 1 commit
- Add LlavaLlamaForCausaLM in MultiModal Processors (#5039) · 69df9761
  Ravi Theja authored Apr 04, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  69df9761
31 Mar, 2025 1 commit
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
28 Mar, 2025 1 commit
- [CI] Remove unused imports with Ruff to pre-commit config, only to... · b149b393
  Brayden Zhong authored Mar 27, 2025
```
[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)
```
  b149b393
27 Mar, 2025 2 commits
- Basic Cleanup (#4833) · 98a2cfa9
  Daniel Holanda authored Mar 27, 2025
  
  98a2cfa9
- Update MMMU Benchmark instructions (#4694) · e6e4d022
  Ravi Theja authored Mar 28, 2025
  
  e6e4d022
25 Mar, 2025 2 commits
- [Benchmark] tilelang vs deepgemm vs w8a8_block_fp8_matmul (#4735) · 14269198
  Chunan Zeng authored Mar 24, 2025
  
  14269198
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
24 Mar, 2025 1 commit
- rename benchmark_deepgemm_fp8_group_gemm.py (#4605) · 3980ff1b
  Tongbao Zhang authored Mar 24, 2025
  
  3980ff1b
23 Mar, 2025 1 commit
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
22 Mar, 2025 2 commits
- Add EAGLE mtbench benchmark script (#4676) · 8f163b16
  Ke Bao authored Mar 23, 2025
```
Co-authored-by: chromecast56 <jamesll@mit.edu>
```
  8f163b16
- Correcting default configuration when benchmarking fused_moe (#4665) · 38f25e87
  penguin_wwy authored Mar 22, 2025
  
  38f25e87
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
18 Mar, 2025 1 commit
- refactor: rewrite bench-mmmu-sglang (#4458) · 98be3bd3
  Mick authored Mar 18, 2025
  
  98be3bd3