Commits · e86b1ccbf07d29ec040b5d1d4092f152237db0f8 · change / sglang

"clients/vscode:/vscode.git/clone" did not exist on "83b84486ad9e35bff1d5f2d166db296b767542c7"

15 Aug, 2024 5 commits
- Enable chunked prefill by default (#1040) · e86b1ccb
  Lianmin Zheng authored Aug 14, 2024
  
  e86b1ccb
- [Fix] fix the typo bug for window attention (#1106) · 8d2d876f
  Ying Sheng authored Aug 14, 2024
  
  8d2d876f
- Use a single workspace for flashinfer (#1077) · 326df4ba
  Lianmin Zheng authored Aug 14, 2024
  
  326df4ba
- Support jinja as chat template file (#1104) · 6767e222
  Ying Sheng authored Aug 14, 2024
  
  6767e222
- Support `stop_token_ids` in sglang API (#1092) · 73cf6834
  Liangsheng Yin authored Aug 14, 2024
  
  73cf6834
14 Aug, 2024 12 commits
- docs: update nsys usage (#1103) · 1c2b5f52
  Yineng Zhang authored Aug 15, 2024
  
  1c2b5f52
- [Fix] Compatibility of window attention and cuda graph (#1090) · 96a2093e
  Ying Sheng authored Aug 14, 2024
  
  96a2093e
- Use `dtype` to control generate (#1082) · a34dd86a
  Liangsheng Yin authored Aug 14, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a34dd86a
- docs: update pr template (#1099) · 67c0d832
  Yineng Zhang authored Aug 14, 2024
  
  67c0d832
- Update grok 1 model (#1095) · a59636bb
  Lianmin Zheng authored Aug 14, 2024
  
  a59636bb
- docs: update README (#1098) · fe502432
  Yineng Zhang authored Aug 14, 2024
  
  fe502432
- ci: remove workflow path trigger (#1096) · f14569f6
  Yineng Zhang authored Aug 14, 2024
  
  f14569f6
- Fix a bug in cuda graph runner (#1094) · 8f790ac1
  Lianmin Zheng authored Aug 14, 2024
  
  8f790ac1
- [Feature] modify Runtime to support skip_tokenizer_init (#1088) · 616b59f3
  rainred authored Aug 14, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  616b59f3
- ci: update timeout and retry (#1086) · c8423ca3
  Yineng Zhang authored Aug 14, 2024
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  c8423ca3
- Fix jump forward final state circular path bug. (#1084) · e205527c
  Liangsheng Yin authored Aug 13, 2024
  
  e205527c
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
13 Aug, 2024 10 commits
- Update the mixtral to use the better FusedMoE layer (#1081) · ad3e4f16
  Lianmin Zheng authored Aug 13, 2024
  
  ad3e4f16
- Example file for docker compose and k8s (#1006) · 312e8492
  Lucien authored Aug 14, 2024
  
  312e8492
- Fix create_abort_task, GenerateReqInput does not have rids. (#1079) · 95f5fbf1
  rainred authored Aug 13, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  95f5fbf1
- ci: add accuracy timeout (#1078) · cebd78d8
  Yineng Zhang authored Aug 13, 2024
  
  cebd78d8
- fix: use devel for Triton's compiler requirements (#1074) · 0076f115
  Yineng Zhang authored Aug 13, 2024
  
  0076f115
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
- ci: add cancel pr workflow (#1070) · 396a13e6
  Yineng Zhang authored Aug 13, 2024
  
  396a13e6
- fix: temporary solution for DeepSeek V2 H100 layout conversion issue (#1060) · 65915f9f
  Yineng Zhang authored Aug 13, 2024
```
Co-authored-by: ispobock <ISPObaoke@163.com>
```
  65915f9f
- Fix layernorm input shape (#1066) · 162f3ccb
  Ke Bao authored Aug 13, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  162f3ccb
- fix: not use the default port (#1068) · 65e89bae
  Yineng Zhang authored Aug 13, 2024
  
  65e89bae
12 Aug, 2024 13 commits
- feat: replace all rmsnorm and silu (#1057) · 6a38efa8
  Yineng Zhang authored Aug 13, 2024
  
  6a38efa8
- chore: bump v0.2.12 (#1048) · b0ad0c1b
  Yineng Zhang authored Aug 12, 2024
  
  b0ad0c1b
- Re-organize CI tests (#1052) · c877292c
  Lianmin Zheng authored Aug 12, 2024
  
  c877292c
- Fix accuracy test (#1051) · 0c1c72a0
  Lianmin Zheng authored Aug 12, 2024
  
  0c1c72a0
- Add longer accuracy test on CI (#1049) · 41598e0d
  Lianmin Zheng authored Aug 12, 2024
  
  41598e0d
- docs: update setup github runner (#1050) · 89f23a51
  Yineng Zhang authored Aug 12, 2024
  
  89f23a51
- feat: update Dockerfile (#1033) · cb99ba4f
  Yineng Zhang authored Aug 12, 2024
```
Co-authored-by: vhain <vhain6512@gmail.com>
```
  cb99ba4f
- fix: Fix returned prefill logits and add output str test (#1046) · 32f61443
  Ying Sheng authored Aug 11, 2024
  
  32f61443
- Clean up the comments and names under python/sglang/srt/layers (#1047) · fb1f28cb
  Lianmin Zheng authored Aug 11, 2024
  
  fb1f28cb
- minor: some potential bugs (#1044) · fb7421db
  Liangsheng Yin authored Aug 11, 2024
  
  fb7421db
- Delete the useless test/srt/test_throughput.py (#1045) · 14b64930
  Lianmin Zheng authored Aug 11, 2024
  
  14b64930
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
- Fix the prefix indices (#1037) · 7de60345
  Liangsheng Yin authored Aug 11, 2024
  
  7de60345