Commits · b91a4cb1b1c21b94ca74f4e75305e4b26673dc5b · change / sglang · GitLab

09 Aug, 2024 2 commits
- support models from www.modelscope.cn (#994) · b91a4cb1
  liuyhwangyh authored Aug 09, 2024
```
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
```
  b91a4cb1
- test: negative value testing for frequency, presence penalizers (#995) · 95a28019
  Juwan Yoo authored Aug 08, 2024
  
  95a28019
08 Aug, 2024 12 commits
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
- Move torch.compile configs into cuda_graph_runner.py (#993) · 9f662501
  Ying Sheng authored Aug 08, 2024
  
  9f662501
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- Create contributor_guide.md (#992) · 228cf475
  Ying Sheng authored Aug 08, 2024
  
  228cf475
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
- Adjust `InputeMetadata` and `ScheduleBatch` (#981) · 1ac304ee
  Liangsheng Yin authored Aug 08, 2024
  
  1ac304ee
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
- Add e5-mistral modules [unreachable code] - step 1/3 (#983) · 0de7c2d0
  Ying Sheng authored Aug 08, 2024
  
  0de7c2d0
- Fix chunked prefill (#984) · 6ed4e3b8
  Liangsheng Yin authored Aug 07, 2024
  
  6ed4e3b8
- [minor] Update type annotation in tokenizer_manager.py (#982) · 00023d62
  Ying Sheng authored Aug 07, 2024
  
  00023d62
- #590 Increase default , track changes in examples and documentation (#971) · c62d560c
  foszto authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  c62d560c
- Adjust max prefix len (#980) · 2b8257f3
  Liangsheng Yin authored Aug 07, 2024
  
  2b8257f3
07 Aug, 2024 16 commits
- RadixCache method adjust (#977) · 7623091d
  Liangsheng Yin authored Aug 07, 2024
  
  7623091d
- PrefillAdder abstraction (#968) · f724f1f1
  Liangsheng Yin authored Aug 07, 2024
  
  f724f1f1
- misc: correct the int data type for token ids and indices (#969) · 6db27f7b
  Zhiqiang Xie authored Aug 07, 2024
  
  6db27f7b
- Run purge-cache only in sgl-project (#976) · 4d929107
  Liangsheng Yin authored Aug 07, 2024
  
  4d929107
- Purge self-runner's pip cache weekly (#975) · fbe0c818
  Liangsheng Yin authored Aug 07, 2024
  
  fbe0c818
- chore: bump v0.2.11 (#970) · dc9d06d8
  Yineng Zhang authored Aug 07, 2024
  
  dc9d06d8
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
- misc: fix the req_to_token member change (#967) · a01ddd96
  Liangsheng Yin authored Aug 07, 2024
  
  a01ddd96
- Make `req_pool_indices` on CPU (#960) · 7fa54a1a
  Liangsheng Yin authored Aug 07, 2024
  
  7fa54a1a
- misc: add compute capability in check_env (#965) · 05abd126
  Yineng Zhang authored Aug 07, 2024
  
  05abd126
- misc: simplify test (#964) · 5f6fa04a
  yichuan~ authored Aug 07, 2024
  
  5f6fa04a
- misc: update issue template (#963) · 58a09708
  Yineng Zhang authored Aug 07, 2024
  
  58a09708
- Show more error messages for warmup errors (#932) · ff68ae85
  Ying Sheng authored Aug 06, 2024
  
  ff68ae85
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
- fix nsys cannot profile cuda kernel (#957) · 41bb1ab1
  Meng, Peng authored Aug 07, 2024
  
  41bb1ab1
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
06 Aug, 2024 1 commit
- Fix stuck in `get_new_prefill_batch` (#948) · ad56e684
  Liangsheng Yin authored Aug 06, 2024
  
  ad56e684
05 Aug, 2024 9 commits
- Support multiple args options (#941) · ffb15744
  yichuan~ authored Aug 06, 2024
  
  ffb15744
- Fix union operator (#940) · a9c833d5
  Ke Bao authored Aug 06, 2024
  
  a9c833d5
- Feat: add alternative choices selection methods (#835) · 94e01151
  Aidan Cooper authored Aug 05, 2024
  
  94e01151
- Remove leftover auth_token (#934) · b216a545
  Aidan Cooper authored Aug 05, 2024
  
  b216a545
- docs: update README (#935) · fde83405
  Yineng Zhang authored Aug 05, 2024
  
  fde83405
- Fix prompt len in parallel sampling (#928) · fd7926e4
  yichuan~ authored Aug 05, 2024
  
  fd7926e4
- Update README.md (#927) · 399cad91
  Ying Sheng authored Aug 04, 2024
  
  399cad91
- Test regex in vision api (#926) · 0a4f5f9b
  Ying Sheng authored Aug 04, 2024
  
  0a4f5f9b
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f