Commits · fb7421db0ddcb263b2cd1d8bbbe63282c97606aa · change / sglang

"vscode:/vscode.git/clone" did not exist on "178480ed3be30bc33dafead53b5ee09c717fa2b7"

12 Aug, 2024 4 commits
- minor: some potential bugs (#1044) · fb7421db
  Liangsheng Yin authored Aug 11, 2024
  
  fb7421db
- Delete the useless test/srt/test_throughput.py (#1045) · 14b64930
  Lianmin Zheng authored Aug 11, 2024
  
  14b64930
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
- Fix the prefix indices (#1037) · 7de60345
  Liangsheng Yin authored Aug 11, 2024
  
  7de60345
11 Aug, 2024 10 commits
- Test the case when max_new_tokens is very large (#1038) · d84c5e70
  Lianmin Zheng authored Aug 11, 2024
  
  d84c5e70
- Fix the case when max_new_tokens is too large (#1025) · d7854120
  Lianmin Zheng authored Aug 11, 2024
  
  d7854120
- Fix triton args init (#1034) · 7b6a5332
  Liangsheng Yin authored Aug 11, 2024
  
  7b6a5332
- Fix the case where r.prefix_indices is None (#1031) · 4080e822
  Lianmin Zheng authored Aug 11, 2024
  
  4080e822
- hotfix: add CustomOp abstraction (#1027) · c245b789
  Yineng Zhang authored Aug 11, 2024
  
  c245b789
- Improve type annotation (#1029) · 9dae4078
  Lianmin Zheng authored Aug 11, 2024
  
  9dae4078
- Fix wrong assert (#1028) · fcc0f5ed
  Liangsheng Yin authored Aug 11, 2024
  
  fcc0f5ed
- Clean up readme and arguments of chunked prefill (#1022) · a97df791
  Lianmin Zheng authored Aug 11, 2024
  
  a97df791
- misc: update issue template (#1024) · 33d61356
  Yineng Zhang authored Aug 11, 2024
  
  33d61356
- feat: use FlashInfer rmsnorm and silu (#907) · 94752ac8
  Yineng Zhang authored Aug 11, 2024
  
  94752ac8
10 Aug, 2024 5 commits
- Fix `input_ids` && rename to `fill_ids` (#1021) · 43fbb6d9
  Liangsheng Yin authored Aug 10, 2024
  
  43fbb6d9
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
- fix: force max new tokens to be 1 for embedding request (#1019) · b68c4c07
  Ying Sheng authored Aug 10, 2024
  
  b68c4c07
- misc: update test config (#990) · e712837d
  Yineng Zhang authored Aug 11, 2024
  
  e712837d
- Support embedding input as a list (#1014) · 7599bade
  Ying Sheng authored Aug 10, 2024
  
  7599bade
09 Aug, 2024 10 commits
- Reduce the overhead when cache is disabled (#1010) · 62757db6
  Liangsheng Yin authored Aug 09, 2024
  
  62757db6
- Some warnings to crash when CI (#1009) · 73fa2d49
  Liangsheng Yin authored Aug 09, 2024
  
  73fa2d49
- Fix benchmark latency (#1007) · 61728884
  Mingyi authored Aug 09, 2024
  
  61728884
- Add skip_tokenizer_init args. (#959) · 9cf0a5ba
  gryffindor-rr authored Aug 10, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  9cf0a5ba
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
- Minor bugfix on benchmark serving (#1005) · 05c50a82
  Roger Wang authored Aug 09, 2024
  
  05c50a82
- fix: resolve correctness_test issue (#1002) · b568df5d
  Yineng Zhang authored Aug 09, 2024
  
  b568df5d
- bugfix: penalizers to be merged before reqs (#1001) · 10bca45b
  Juwan Yoo authored Aug 09, 2024
  
  10bca45b
- support models from www.modelscope.cn (#994) · b91a4cb1
  liuyhwangyh authored Aug 09, 2024
```
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
```
  b91a4cb1
- test: negative value testing for frequency, presence penalizers (#995) · 95a28019
  Juwan Yoo authored Aug 08, 2024
  
  95a28019
08 Aug, 2024 11 commits
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
- Move torch.compile configs into cuda_graph_runner.py (#993) · 9f662501
  Ying Sheng authored Aug 08, 2024
  
  9f662501
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- Create contributor_guide.md (#992) · 228cf475
  Ying Sheng authored Aug 08, 2024
  
  228cf475
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
- Adjust `InputeMetadata` and `ScheduleBatch` (#981) · 1ac304ee
  Liangsheng Yin authored Aug 08, 2024
  
  1ac304ee
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
- Add e5-mistral modules [unreachable code] - step 1/3 (#983) · 0de7c2d0
  Ying Sheng authored Aug 08, 2024
  
  0de7c2d0
- Fix chunked prefill (#984) · 6ed4e3b8
  Liangsheng Yin authored Aug 07, 2024
  
  6ed4e3b8
- [minor] Update type annotation in tokenizer_manager.py (#982) · 00023d62
  Ying Sheng authored Aug 07, 2024
  
  00023d62
- #590 Increase default , track changes in examples and documentation (#971) · c62d560c
  foszto authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  c62d560c