Commits · 06427dfab12b8cb149809ca17ddfa61c97b7b70e · change / sglang

25 Feb, 2025 2 commits
- [doc] added quantization doc for dpsk (#3843) · 06427dfa
  Shenggui Li authored Feb 26, 2025
  
  06427dfa
- [improve] made timeout configurable (#3803) · c0bb9eb3
  Shenggui Li authored Feb 25, 2025
  
  c0bb9eb3
23 Feb, 2025 1 commit
- [Docs]Add instruction for manually stopping nsys profiler (#3795) · 4d2a88bd
  Baizhou Zhang authored Feb 23, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  4d2a88bd
22 Feb, 2025 1 commit
- bench: Add MMMU benchmark for vLM (#3562) · 45205d88
  Mick authored Feb 23, 2025
  
  45205d88
21 Feb, 2025 4 commits
- Model: Support Qwen 72B RM model. (#3772) · 20b765a2
  simveit authored Feb 21, 2025
  
  20b765a2
- Docs: Fix layout to docs (#3733) · 4592afc2
  simveit authored Feb 21, 2025
  
  4592afc2
- Change description of nvidia jetson docs (#3761) · d8d75d25
  Shakhizat Nurgaliyev authored Feb 21, 2025
  
  d8d75d25
- [docs] added torch.compile cache to dpsk manual (#3737) · c6a48521
  Shenggui Li authored Feb 21, 2025
  
  c6a48521
20 Feb, 2025 1 commit
- [Docs] Modify ep related server args and remove cublas part of deepseek (#3732) · ac053100
  Baizhou Zhang authored Feb 20, 2025
  
  ac053100
19 Feb, 2025 1 commit
- Docs: Fix layout with sub-section (#3710) · 3c7bfd7e
  Chayenne authored Feb 19, 2025
  
  3c7bfd7e
18 Feb, 2025 2 commits
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
- Docs: Deploy multi-node inference (LWS method) using sglang in a K8s cluster (#3624) · c51dc2cc
  ybyang authored Feb 18, 2025
  
  c51dc2cc
17 Feb, 2025 2 commits
- [docker] added rdma support (#3619) · c9565e49
  Shenggui Li authored Feb 17, 2025
  
  c9565e49
- [docs] Update sampling_params.md (#3617) · d03c4c25
  Shi Shuai authored Feb 17, 2025
  
  d03c4c25
16 Feb, 2025 2 commits
- Draft of updated doc for sampling params. (#3260) · 8f13377d
  simveit authored Feb 16, 2025
```
Co-authored-by: shuaills <shishuaicareer@gmail.com>
```
  8f13377d
- Model: Support Qwen 2.5 vl (#3258) · bcc213df
  Mick authored Feb 16, 2025
  
  bcc213df
13 Feb, 2025 1 commit
- Update DeepSeek V3 Doc (#3541) · bf2a7087
  Jhin authored Feb 13, 2025
  
  bf2a7087
12 Feb, 2025 2 commits
- added llama and cleaned up (#3503) · 8adbc78b
  Zachary Streeter authored Feb 12, 2025
  
  8adbc78b
- doc: Support a new vLM (#3405) · ced68066
  Mick authored Feb 12, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ced68066
11 Feb, 2025 3 commits
- add deepseek-v3 amd docker command (#3495) · 2491cc92
  Zachary Streeter authored Feb 11, 2025
  
  2491cc92
- fix supported_models Qwen typo (#3498) · 9490d157
  Didier Durand authored Feb 11, 2025
  
  9490d157
- fix deepseek_v3 typo (#3497) · eefcbdd3
  Didier Durand authored Feb 11, 2025
  
  eefcbdd3
10 Feb, 2025 1 commit
- Update contribution_guide.md (#3452) · 52a492a1
  Ying Sheng authored Feb 09, 2025
  
  52a492a1
09 Feb, 2025 3 commits
- [docs] Update quantization documentation (#3437) · 20cf910d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: jamessand <shazhizhou0@gmail.com>
```
  20cf910d
- [Docs] Add quantization docs (#3410) · 0af1d239
  Wenxuan Tan authored Feb 09, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  0af1d239
- [docs] Add multi-node inference example for SLURM in documentation (#3408) · 6702592d
  Shi Shuai authored Feb 09, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: aflah02 <aflah20082@iiitd.ac.in>
```
  6702592d
07 Feb, 2025 3 commits
- added amd_configure.md to references (#3275) · 0a6f18f0
  Zachary Streeter authored Feb 07, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  0a6f18f0
- Fix: Runtime error for function calling (#3300) · 591e751e
  Shi Shuai authored Feb 07, 2025
  
  591e751e
- Docs/CI: Enable Fake Finish for Docs Only PR (#3350) · 76ca91df
  Chayenne authored Feb 06, 2025
  
  76ca91df
03 Feb, 2025 1 commit

Add a Doc about guide on nvidia jetson #3182 (#3205) · 455bfe8d

Liangjun Song authored Feb 03, 2025


Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

455bfe8d

02 Feb, 2025 2 commits
- Docs: Update accuracy evaluation (#3261) · 55f5fc68
  Chayenne authored Feb 02, 2025
  
  55f5fc68
- docs/accuracy evaluation (#3114) · c27c378a
  simveit authored Feb 02, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  c27c378a
31 Jan, 2025 2 commits
- [Docs] Add more details to profiling docs (#3221) · d7c0b32f
  Wenxuan Tan authored Jan 31, 2025
  
  d7c0b32f
- Docs: Update supported models with Mistral 3 (#3229) · 9829e77e
  Ravi Theja authored Jan 31, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  9829e77e
28 Jan, 2025 1 commit
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
24 Jan, 2025 1 commit
- [Docs] minor update for phi-3 and phi-4 (#3096) · 4505a436
  Adarsh Shirawalmath authored Jan 24, 2025
  
  4505a436
22 Jan, 2025 1 commit
- [Doc] Update doc of profiling with PyTorch Profiler (#3038) · b3393e94
  Baizhou Zhang authored Jan 22, 2025
  
  b3393e94
21 Jan, 2025 1 commit
- [Doc] Update doc of custom logit processor (#3021) · 949b3fbf
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  949b3fbf
20 Jan, 2025 2 commits
- Docs: Add Performance Demonstaration for DPA (#3005) · 2584f6d9
  Chayenne authored Jan 20, 2025
  
  2584f6d9
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890