Commits · 34b364e07355f5216babd8c6fac7cb476f85e42c · change / sglang

04 Dec, 2024 1 commit
- Add Docs For SGLang Native Router (#2308) · 18ea841f
  Chayenne authored Dec 04, 2024
  
  18ea841f
22 Nov, 2024 1 commit
- feat(pre-commit): trim unnecessary notebook metadata from git history (#2127) · 72f87b72
  Xuehai Pan authored Nov 23, 2024
  
  72f87b72
11 Nov, 2024 1 commit
- Add Engine::encode example (#2000) · 9d427265
  James Xu authored Nov 11, 2024
  
  9d427265
08 Nov, 2024 1 commit
- Monitoring documentation (#1933) · 5bc2508b
  Yudi Xue authored Nov 07, 2024
  
  5bc2508b
07 Nov, 2024 1 commit
- fix black in pre-commit (#1940) · c77c1e05
  Chayenne authored Nov 07, 2024
  
  c77c1e05
06 Nov, 2024 1 commit
- minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) · a5e0defb
  Xuehai Pan authored Nov 06, 2024
  
  a5e0defb
05 Nov, 2024 1 commit
- Change judge to classify & Modify make file (#1920) · 02755768
  Chayenne authored Nov 04, 2024
  
  02755768
03 Nov, 2024 1 commit
- Unify the model type checking (#1905) · 0abbf289
  Lianmin Zheng authored Nov 03, 2024
  
  0abbf289
27 Oct, 2024 1 commit
- Support token ids in `engine.generate` (#1820) · 6fcd6d7d
  Byron Hsu authored Oct 27, 2024
  
  6fcd6d7d
20 Oct, 2024 1 commit
- Update vllm to 0.6.3 (#1711) (#1720) · 8bee20f8
  Yineng Zhang authored Oct 19, 2024
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  8bee20f8
11 Oct, 2024 1 commit
- [engine] support async and streaming (#1614) · 862cd265
  Byron Hsu authored Oct 11, 2024
  
  862cd265
07 Oct, 2024 1 commit
- Provide an offline engine API (#1567) · 551a3a9d
  Byron Hsu authored Oct 06, 2024
  
  551a3a9d
06 Oct, 2024 1 commit
- Support min_tokens in sgl.gen (#1573) · 2422de51
  Byron Hsu authored Oct 05, 2024
  
  2422de51
04 Oct, 2024 2 commits
- [Minifix] Remove extra space in cot example (#1569) · 2432ad40
  FredericOdermatt authored Oct 04, 2024
  
  2432ad40
- Use ipc instead of tcp in zmq (#1566) · 114bbc86
  Lianmin Zheng authored Oct 04, 2024
  
  114bbc86
02 Oct, 2024 1 commit
- [Fix] Fix all the Huggingface paths (#1553) · 2c7d0a5b
  Theresa Barton authored Oct 02, 2024
  
  2c7d0a5b
30 Sep, 2024 1 commit
- [Fix, LoRA] fix LoRA with updates in main (#1545) · 0f4fb19b
  Ying Sheng authored Sep 30, 2024
  
  0f4fb19b
28 Sep, 2024 2 commits
- Multiple minor fixes (#1530) · 4e4459b9
  Lianmin Zheng authored Sep 28, 2024
  
  4e4459b9
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
22 Sep, 2024 1 commit
- [API, Feature] Support response prefill for openai API (#1490) · e4780cf8
  Ying Sheng authored Sep 22, 2024
  
  e4780cf8
19 Sep, 2024 1 commit
- fix: creat new dict everytime for putting new frame (#1464) · 446ea332
  Li Bo authored Sep 19, 2024
  
  446ea332
15 Sep, 2024 1 commit
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
09 Sep, 2024 2 commits
- [Minor] Many cleanup (#1357) · e4d68afc
  Lianmin Zheng authored Sep 09, 2024
  
  e4d68afc
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
03 Sep, 2024 1 commit
- [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308) · f64eae3a
  Lianmin Zheng authored Sep 02, 2024
  
  f64eae3a
01 Sep, 2024 1 commit
- [Chore] Rename model_overide_args to model_override_args (#1284) · 08360553
  Kai-Hsun Chen authored Sep 01, 2024
```
Signed-off-by: Kai-Hsun Chen <kaihsun@anyscale.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  08360553
28 Aug, 2024 2 commits
- [Fix] Fix OOM in llava base class (#1249) · 0a97d796
  Lianmin Zheng authored Aug 28, 2024
  
  0a97d796
- [Fix] Fix llava on multi images (#1247) · bf53bf51
  Lianmin Zheng authored Aug 28, 2024
  
  bf53bf51
27 Aug, 2024 1 commit
- [Minor] add delete test and delete tmp file on ci server (#1227) · 5ff25cdf
  yichuan~ authored Aug 26, 2024
  
  5ff25cdf
25 Aug, 2024 1 commit
- [Fix] Fixing the multi-images error for llava-onevision (#1205) · 66e7dcaf
  Kaichen Zhang - NTU authored Aug 26, 2024
  
  66e7dcaf
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
23 Aug, 2024 1 commit

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2... · a5b14ad0

Kaichen Zhang - NTU authored Aug 24, 2024


[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)
Co-authored-by: Bo Li <drluodian@gmail.com>

a5b14ad0

21 Aug, 2024 1 commit
- Improve code style of sampler (#1168) · 83e23c69
  Liangsheng Yin authored Aug 21, 2024
  
  83e23c69
04 Aug, 2024 1 commit
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
01 Aug, 2024 1 commit
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c
30 Jul, 2024 1 commit
- Fix List input bug (#838) · bb0501c0
  yichuan~ authored Jul 31, 2024
  
  bb0501c0
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
28 Jul, 2024 1 commit
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
20 Jul, 2024 2 commits
- Update version to 0.1.22 (#677) · 2b4c6462
  Ying Sheng authored Jul 20, 2024
  
  2b4c6462
- Add support for OpenAI API parallel sampling (#640) · 49c5e0ec
  yichuan~ authored Jul 20, 2024
  
  49c5e0ec