Commits · bb121214c2daaff0f82483ee83ebc8ad636ef7ff · change / sglang · GitLab

18 Feb, 2025 2 commits
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
- Docs: Deploy multi-node inference (LWS method) using sglang in a K8s cluster (#3624) · c51dc2cc
  ybyang authored Feb 18, 2025
  
  c51dc2cc
17 Feb, 2025 2 commits
- [docker] added rdma support (#3619) · c9565e49
  Shenggui Li authored Feb 17, 2025
  
  c9565e49
- [docs] Update sampling_params.md (#3617) · d03c4c25
  Shi Shuai authored Feb 17, 2025
  
  d03c4c25
16 Feb, 2025 2 commits
- Draft of updated doc for sampling params. (#3260) · 8f13377d
  simveit authored Feb 16, 2025
```
Co-authored-by: shuaills <shishuaicareer@gmail.com>
```
  8f13377d
- Model: Support Qwen 2.5 vl (#3258) · bcc213df
  Mick authored Feb 16, 2025
  
  bcc213df
13 Feb, 2025 1 commit
- Update DeepSeek V3 Doc (#3541) · bf2a7087
  Jhin authored Feb 13, 2025
  
  bf2a7087
12 Feb, 2025 2 commits
- added llama and cleaned up (#3503) · 8adbc78b
  Zachary Streeter authored Feb 12, 2025
  
  8adbc78b
- doc: Support a new vLM (#3405) · ced68066
  Mick authored Feb 12, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ced68066
11 Feb, 2025 3 commits
- add deepseek-v3 amd docker command (#3495) · 2491cc92
  Zachary Streeter authored Feb 11, 2025
  
  2491cc92
- fix supported_models Qwen typo (#3498) · 9490d157
  Didier Durand authored Feb 11, 2025
  
  9490d157
- fix deepseek_v3 typo (#3497) · eefcbdd3
  Didier Durand authored Feb 11, 2025
  
  eefcbdd3
10 Feb, 2025 1 commit
- Update contribution_guide.md (#3452) · 52a492a1
  Ying Sheng authored Feb 09, 2025
  
  52a492a1
09 Feb, 2025 3 commits
- [docs] Update quantization documentation (#3437) · 20cf910d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: jamessand <shazhizhou0@gmail.com>
```
  20cf910d
- [Docs] Add quantization docs (#3410) · 0af1d239
  Wenxuan Tan authored Feb 09, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  0af1d239
- [docs] Add multi-node inference example for SLURM in documentation (#3408) · 6702592d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: aflah02 <aflah20082@iiitd.ac.in>
```
  6702592d
07 Feb, 2025 3 commits
- added amd_configure.md to references (#3275) · 0a6f18f0
  Zachary Streeter authored Feb 07, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  0a6f18f0
- Fix: Runtime error for function calling (#3300) · 591e751e
  Shi Shuai authored Feb 07, 2025
  
  591e751e
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
03 Feb, 2025 1 commit

Add a Doc about guide on nvidia jetson #3182 (#3205) · 455bfe8d

Liangjun Song authored Feb 03, 2025


Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

455bfe8d

02 Feb, 2025 2 commits
- Docs: Update accuracy evaluation (#3261) · 55f5fc68
  Chayenne authored Feb 02, 2025
  
  55f5fc68
- docs/accuracy evaluation (#3114) · c27c378a
  simveit authored Feb 02, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  c27c378a
31 Jan, 2025 2 commits
- [Docs] Add more details to profiling docs (#3221) · d7c0b32f
  Wenxuan Tan authored Jan 31, 2025
  
  d7c0b32f
- Docs: Update supported models with Mistral 3 (#3229) · 9829e77e
  Ravi Theja authored Jan 31, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  9829e77e
28 Jan, 2025 1 commit
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
24 Jan, 2025 1 commit
- [Docs] minor update for phi-3 and phi-4 (#3096) · 4505a436
  Adarsh Shirawalmath authored Jan 24, 2025
  
  4505a436
22 Jan, 2025 1 commit
- [Doc] Update doc of profiling with PyTorch Profiler (#3038) · b3393e94
  Baizhou Zhang authored Jan 22, 2025
  
  b3393e94
21 Jan, 2025 1 commit
- [Doc] Update doc of custom logit processor (#3021) · 949b3fbf
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  949b3fbf
20 Jan, 2025 2 commits
- Docs: Add Performance Demonstaration for DPA (#3005) · 2584f6d9
  Chayenne authored Jan 20, 2025
  
  2584f6d9
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
19 Jan, 2025 2 commits
- support regex in xgrammar backend (#2983) · 3bcf5ece
  Enrique Shockwave authored Jan 19, 2025
  
  3bcf5ece
- docs: update supported_models (#2987) · def5c318
  Yineng Zhang authored Jan 20, 2025
  
  def5c318
18 Jan, 2025 1 commit

[Feature] Support minicpmv v2.6 (#2785) · 3d93f84a

Mick authored Jan 19, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

3d93f84a

17 Jan, 2025 1 commit
- Fix Llama-3.1-405B References Docs (#2944) · 120c3634
  Wen Sun authored Jan 18, 2025
  
  120c3634
16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
13 Jan, 2025 2 commits
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Fix linear.py and improve weight loading (#2851) · 72c77763
  Lianmin Zheng authored Jan 13, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  72c77763
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
10 Jan, 2025 1 commit
- Doc: add block-wise FP8 in dpsk model reference (#2830) · 5cc11705
  Chayenne authored Jan 10, 2025
  
  5cc11705
09 Jan, 2025 1 commit
- [Doc]: Deepseek reference docs (#2787) · 11fffbc9
  Xiaotong Jiang authored Jan 09, 2025
  
  11fffbc9