Commits · 2c1a695ff111cadc200cf97d4c2cbfe95ebecb70 · change / sglang

04 Feb, 2025 2 commits
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
03 Feb, 2025 2 commits

Update server args doc (#3273) · 7b5a3741
simveit authored Feb 04, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
```
7b5a3741

Add a Doc about guide on nvidia jetson #3182 (#3205) · 455bfe8d

Liangjun Song authored Feb 03, 2025


Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

455bfe8d

02 Feb, 2025 3 commits
- ROCm: bump 6.3.0 (#3259) · 566d61d9
  HAI authored Feb 02, 2025
  
  566d61d9
- Docs: Update accuracy evaluation (#3261) · 55f5fc68
  Chayenne authored Feb 02, 2025
  
  55f5fc68
- docs/accuracy evaluation (#3114) · c27c378a
  simveit authored Feb 02, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  c27c378a
31 Jan, 2025 4 commits
- [Docs] Add more details to profiling docs (#3221) · d7c0b32f
  Wenxuan Tan authored Jan 31, 2025
  
  d7c0b32f
- Docs: Quick fix for Speculative_decoding doc (#3228) · 656f7fc1
  Jhin authored Jan 31, 2025
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  656f7fc1
- chore: bump v0.4.2.post1 (#3233) · cf0f7eaf
  Yineng Zhang authored Jan 31, 2025
  
  cf0f7eaf
- Docs: Update supported models with Mistral 3 (#3229) · 9829e77e
  Ravi Theja authored Jan 31, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  9829e77e
28 Jan, 2025 2 commits
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
- Docs fix about EAGLE and streaming output (#3166) · 7b9b4f44
  Jhin authored Jan 27, 2025
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
```
  7b9b4f44
27 Jan, 2025 2 commits
- chore: bump v0.4.2 (#3180) · 4ab43cfb
  Yineng Zhang authored Jan 27, 2025
  
  4ab43cfb
- Doc: Add Docs about EAGLE speculative decoding (#3144) · 9472e699
  Jhin authored Jan 26, 2025
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  9472e699
26 Jan, 2025 2 commits
- [Docs]: Add function calling in index.rst (#3155) · 1acc1f56
  Chayenne authored Jan 26, 2025
  
  1acc1f56
- Feature/function calling update (#2700) · b045841b
  YAMY authored Jan 26, 2025
```
Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  b045841b
24 Jan, 2025 1 commit
- [Docs] minor update for phi-3 and phi-4 (#3096) · 4505a436
  Adarsh Shirawalmath authored Jan 24, 2025
  
  4505a436
23 Jan, 2025 1 commit

Docs: Update doc for server arguments (#2742) · 1c4e0d24

simveit authored Jan 23, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

1c4e0d24

22 Jan, 2025 1 commit
- [Doc] Update doc of profiling with PyTorch Profiler (#3038) · b3393e94
  Baizhou Zhang authored Jan 22, 2025
  
  b3393e94
21 Jan, 2025 1 commit
- [Doc] Update doc of custom logit processor (#3021) · 949b3fbf
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  949b3fbf
20 Jan, 2025 4 commits
- chore: bump v0.4.1.post7 (#3009) · e94fb7cb
  Yineng Zhang authored Jan 20, 2025
  
  e94fb7cb
- Docs: Add Performance Demonstaration for DPA (#3005) · 2584f6d9
  Chayenne authored Jan 20, 2025
  
  2584f6d9
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
- Docs: Only use X-Grammar in structed output (#2991) · 0ffcfdf4
  Chayenne authored Jan 19, 2025
  
  0ffcfdf4
19 Jan, 2025 2 commits
- support regex in xgrammar backend (#2983) · 3bcf5ece
  Enrique Shockwave authored Jan 19, 2025
  
  3bcf5ece
- docs: update supported_models (#2987) · def5c318
  Yineng Zhang authored Jan 20, 2025
  
  def5c318
18 Jan, 2025 1 commit

[Feature] Support minicpmv v2.6 (#2785) · 3d93f84a

Mick authored Jan 19, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

3d93f84a

17 Jan, 2025 1 commit
- Fix Llama-3.1-405B References Docs (#2944) · 120c3634
  Wen Sun authored Jan 18, 2025
  
  120c3634
16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
15 Jan, 2025 1 commit
- chore: bump v0.4.1.post6 (#2899) · b3e99dfb
  Yineng Zhang authored Jan 15, 2025
  
  b3e99dfb
13 Jan, 2025 2 commits
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
11 Jan, 2025 2 commits
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
- chore: bump v0.4.1.post5 (#2840) · f624901c
  Yineng Zhang authored Jan 11, 2025
  
  f624901c
10 Jan, 2025 1 commit
- Doc: add block-wise FP8 in dpsk model reference (#2830) · 5cc11705
  Chayenne authored Jan 10, 2025
  
  5cc11705
09 Jan, 2025 1 commit
- [Doc]: Deepseek reference docs (#2787) · 11fffbc9
  Xiaotong Jiang authored Jan 09, 2025
  
  11fffbc9
08 Jan, 2025 2 commits
- Docs：Update the style of llma 3.1 405B docs (#2789) · 2e6346fc
  Chayenne authored Jan 08, 2025
  
  2e6346fc
- Docs: Rewrite docs for LLama 405B and ModelSpace (#2773) · 977f785d
  mlmz authored Jan 08, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  977f785d
05 Jan, 2025 1 commit
- chore: bump v0.4.1.post4 (#2713) · 2f0d3864
  Yineng Zhang authored Jan 06, 2025
  
  2f0d3864