Commits · 62bbd3439374003aa42ad17151ecb804e232c5a0 · change / sglang

24 Feb, 2025 2 commits
- Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730) · 1a6e9757
  laixin authored Feb 24, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  1a6e9757
- Fix dependency (#3813) · 27a46317
  Lianmin Zheng authored Feb 24, 2025
  
  27a46317
21 Feb, 2025 2 commits
- Add support for nvidia modelopt fp8 kv cache (#3223) · c66b2c9c
  Zhiyu authored Feb 21, 2025
  
  c66b2c9c
- feat: Add SageMaker support (#3740) · 1df6eabd
  Andrew Smith authored Feb 21, 2025
  
  1df6eabd
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
17 Feb, 2025 3 commits
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
- add mtp unit test (#3634) · 32b44d2f
  Yineng Zhang authored Feb 17, 2025
  
  32b44d2f
16 Feb, 2025 1 commit
- Model: Support Qwen 2.5 vl (#3258) · bcc213df
  Mick authored Feb 16, 2025
  
  bcc213df
15 Feb, 2025 1 commit
- fix eagle unit test (#3591) · 6718b109
  Yineng Zhang authored Feb 15, 2025
  
  6718b109
14 Feb, 2025 2 commits
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
11 Feb, 2025 1 commit
- Support Eagle cuda graph for Triton backend (#3500) · 7e6d5fc6
  Ke Bao authored Feb 12, 2025
  
  7e6d5fc6
10 Feb, 2025 3 commits
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
- Support Eagle2 for Triton backend (#3466) · 2d611323
  Ke Bao authored Feb 10, 2025
  
  2d611323
- [Fix] Fix accuracy bug and refactor codes for lora (#3413) · c45cab1c
  Baizhou Zhang authored Feb 09, 2025
  
  c45cab1c
09 Feb, 2025 3 commits
- minor: cleanup test_eagle_infer (#3415) · 60abdb3e
  Yineng Zhang authored Feb 09, 2025
  
  60abdb3e
- [Fix] Fix eagle with disable cuda graph (#3411) · 7b4e61ff
  Ying Sheng authored Feb 08, 2025
  
  7b4e61ff
- add disable cuda graph unit test for eagle 2 (#3412) · 6222e1c2
  Yineng Zhang authored Feb 09, 2025
  
  6222e1c2
07 Feb, 2025 1 commit
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
05 Feb, 2025 2 commits
- Support custom mask for Triton attention (#3317) · a322051e
  Ke Bao authored Feb 06, 2025
  
  a322051e
- Update Triton extend backend interface (#3309) · de553334
  Ke Bao authored Feb 05, 2025
  
  de553334
04 Feb, 2025 3 commits
- Update Triton decode backend interface (#3292) · a07364cc
  Ke Bao authored Feb 04, 2025
  
  a07364cc
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
03 Feb, 2025 1 commit
- optimize test_fused_moe style (#3268) · 3c8ac78d
  Xiaoyu Zhang authored Feb 03, 2025
  
  3c8ac78d
01 Feb, 2025 1 commit
- Add test for fp8 torch compile (#3246) · 53179026
  Ke Bao authored Feb 01, 2025
  
  53179026
31 Jan, 2025 1 commit
- [fix] Clamp logprob with dtype min to prevent `-inf` (#3224) · 734daedd
  Byron Hsu authored Jan 31, 2025
  
  734daedd
30 Jan, 2025 1 commit
- [test] Lower number of top logprobs to get rid of `-inf` (#3212) · 20453cef
  Byron Hsu authored Jan 30, 2025
  
  20453cef
28 Jan, 2025 3 commits
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
- [kernel] Use sgl_kernel rope (#3169) · 988d0a4b
  Byron Hsu authored Jan 27, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  988d0a4b
- [test] deduplicate test_session_control (#3183) · 27aeb4b7
  Byron Hsu authored Jan 27, 2025
  
  27aeb4b7
27 Jan, 2025 4 commits
- Update thresholds in test_nightly_gsm8k_eval.py (#3176) · f8ca66fb
  Lianmin Zheng authored Jan 27, 2025
  
  f8ca66fb
- Add activation parameters to fused_moe (#3170) · 52c03f16
  Lianmin Zheng authored Jan 27, 2025
  
  52c03f16
- add unit test for block wise fp8 (#3156) · 1e3e5215
  yizhang2077 authored Jan 27, 2025
  
  1e3e5215
- Add more logprob tests (#3162) · af02f99b
  Lianmin Zheng authored Jan 26, 2025
  
  af02f99b
26 Jan, 2025 3 commits
- Feature/function calling update (#2700) · b045841b
  YAMY authored Jan 26, 2025
```
Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  b045841b
- Add a test case for cached_tokens (#3145) · d1a08632
  Lianmin Zheng authored Jan 26, 2025
  
  d1a08632
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2