Commits · 7282ab741a4d07dfb775cbba7fd442b68fddfeeb · change / sglang · GitLab

21 Apr, 2025 2 commits
- [Feat.] Enable grafana to show metrics (#4718) · 57131dd9
  Huapeng Zhou authored Apr 21, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  57131dd9
- add function call parser for DeepSeek V3 (#5224) · fac17acf
  Yi Zhou authored Apr 21, 2025
  
  fac17acf
20 Apr, 2025 2 commits
- Super tiny fix typo (#5559) · 9c434777
  fzyzcjy authored Apr 21, 2025
  
  9c434777
- [Doc]Add instruction for profiling with bench_one_batch (#5581) · b54b5a96
  Baizhou Zhang authored Apr 20, 2025
  
  b54b5a96
17 Apr, 2025 2 commits
- Deprecate enable-flashinfer-mla and enable-flashmla (#5480) · 6fb29ffd
  Baizhou Zhang authored Apr 17, 2025
  
  6fb29ffd
- Deprecate disable-mla (#5481) · 4fb05583
  Baizhou Zhang authored Apr 17, 2025
  
  4fb05583
16 Apr, 2025 2 commits
- [doc] Update benchmark_and_profiling.md (#5449) · 06a1656e
  Xiaoyu Zhang authored Apr 16, 2025
  
  06a1656e
- Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) · a42736bb
  Baizhou Zhang authored Apr 15, 2025
  
  a42736bb
15 Apr, 2025 1 commit
- [Fix] Turn off DeepGEMM by default (#5263) · f6772f14
  Baizhou Zhang authored Apr 14, 2025
  
  f6772f14
11 Apr, 2025 1 commit
- [Docs] Remove the older supported docs section (#5301) · a0a9f6d6
  Adarsh Shirawalmath authored Apr 12, 2025
  
  a0a9f6d6
09 Apr, 2025 1 commit
- docs: remove the use of Downward API for LWS_WORKER_INDEX (#5110) · f2b70afd
  Kay Yan authored Apr 09, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  f2b70afd
08 Apr, 2025 1 commit
- Add Llama4 user guide (#5133) · ade714a6
  Ke Bao authored Apr 08, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  ade714a6
07 Apr, 2025 1 commit

Add Llama4 support (#5092) · f04c80dc

Chang Su authored Apr 07, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

f04c80dc

05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
29 Mar, 2025 1 commit
- Tiny fix doc error (#4795) · 736502d4
  fzyzcjy authored Mar 29, 2025
  
  736502d4
27 Mar, 2025 3 commits
- Update doc for DeepSeek-V3-0324 (#4825) · b3953258
  Ke Bao authored Mar 28, 2025
  
  b3953258
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
- Update supported_models.md: adding open-r1 Olympic Code 32B by HuggingFace (#4628) · 44f47d3e
  Didier Durand authored Mar 27, 2025
  
  44f47d3e
25 Mar, 2025 2 commits
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
22 Mar, 2025 1 commit
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
21 Mar, 2025 1 commit
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
20 Mar, 2025 1 commit
- Update doc for MTP and DP attention (#4622) · bfb03c61
  Ke Bao authored Mar 21, 2025
  
  bfb03c61
18 Mar, 2025 1 commit
- Fix the incorrect args in benchmark_and_profiling.md (#4542) · 2d004512
  Albert authored Mar 18, 2025
```
Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
```
  2d004512
17 Mar, 2025 3 commits
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
- [Feature] Support Deepseek-VL2 (#2798) · d6d21640
  萝卜菜 authored Mar 17, 2025
```
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  d6d21640
- Urgent model support: support gemma-3-it (#4424) · 9d02bb3e
  Mick authored Mar 17, 2025
  
  9d02bb3e
15 Mar, 2025 1 commit
- docs: Add Llama 3.3 to supported models (#4453) · 26c372c1
  江家瑋 authored Mar 16, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  26c372c1
14 Mar, 2025 1 commit
- [Doc] fix wrong flag in deepseek documentation (#4427) · 660305c3
  Zhan Lu authored Mar 14, 2025
  
  660305c3
12 Mar, 2025 2 commits
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
- [Docs] Clean up benchmark_and_profiling.md (#4297) · 8f1f614e
  Michael Yao authored Mar 12, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  8f1f614e
11 Mar, 2025 1 commit
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
09 Mar, 2025 2 commits
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
07 Mar, 2025 4 commits
- [Docs] Improve bullets appearance and grammar (#4174) · c827c671
  Michael Yao authored Mar 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c827c671
- fix int8 doc link (#4179) · b55a621f
  Yineng Zhang authored Mar 07, 2025
  
  b55a621f
- Add an example of using deepseekv3 int8 sglang. (#4177) · ffa1b3e3
  lukec authored Mar 07, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  ffa1b3e3
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8