Commits · f06e90c2cfb41f283a22ee705ca20d2f451aab6e · change / sglang

25 May, 2024 1 commit
- Optimize retract (#440) · f06e90c2
  Liangsheng Yin authored May 26, 2024
  
  f06e90c2
24 May, 2024 1 commit
- fix test bug in srt_llava_next_test.py (#470) · 3167d8da
  bing authored May 24, 2024
  
  3167d8da
21 May, 2024 3 commits
- Use model loader from vllm (#459) · 19d2135c
  Lianmin Zheng authored May 21, 2024
  
  19d2135c
- Rename api_num_spec_tokens -> num_api_spec_tokens (#458) · ced77c66
  Lianmin Zheng authored May 20, 2024
  
  ced77c66
- Fix openai speculative execution (#456) · 3e684be7
  Ying Sheng authored May 20, 2024
  
  3e684be7
19 May, 2024 1 commit
- openai chat speculative execution (#250) · ec380dfd
  LiviaSun authored May 18, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  ec380dfd
14 May, 2024 1 commit
- [Feat] Add llava qwen, llava mistral (#419) · 664287b2
  Kaichen Zhang - NTU authored May 14, 2024
```
Co-authored-by: Bo Li <drluodian@gmail.com>
```
  664287b2
13 May, 2024 2 commits
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
- Handle truncation errors (#436) · 5dc55a5f
  Lianmin Zheng authored May 13, 2024
  
  5dc55a5f
30 Apr, 2024 1 commit
- Adding RAG tracing & eval cookbook using Parea (#390) · 5c5aba59
  Joschka Braun authored Apr 30, 2024
  
  5c5aba59
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
23 Mar, 2024 1 commit
- Openrouter usage example (#327) · 64ee9c03
  Jani Monoses authored Mar 23, 2024
  
  64ee9c03
22 Mar, 2024 2 commits
- Update version to v0.1.14 (#324) · 51104cd4
  Lianmin Zheng authored Mar 22, 2024
  
  51104cd4
- Use Anthropic messages API (#304) · e57f0792
  Jani Monoses authored Mar 22, 2024
  
  e57f0792
13 Mar, 2024 1 commit
- Fix Incorrect CURL Request Example in README (#287) · 745ea007
  Arsalan authored Mar 12, 2024
  
  745ea007
12 Mar, 2024 1 commit
- adding the triton docker build minimal example (#242) · eb4308c4
  Arsalan authored Mar 12, 2024
  
  eb4308c4
12 Feb, 2024 1 commit
- Add Together and AzureOpenAI examples (#184) · bb824da4
  Lianmin Zheng authored Feb 12, 2024
  
  bb824da4
11 Feb, 2024 1 commit
- Update version to 0.1.12 (#178) · 624b21e7
  Lianmin Zheng authored Feb 11, 2024
  
  624b21e7
09 Feb, 2024 1 commit
- import outlines (#168) · 37b42297
  Liangsheng Yin authored Feb 09, 2024
  
  37b42297
01 Feb, 2024 2 commits
- update docs for Yi-VL · 03e04b23
  Lianmin Zheng authored Feb 01, 2024
  
  03e04b23
- Yi-VL Model (#112) · 86442530
  Christopher Chou authored Feb 01, 2024
  
  86442530
30 Jan, 2024 2 commits
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
- Update quick start examples (#120) · 06175286
  Lianmin Zheng authored Jan 30, 2024
  
  06175286
25 Jan, 2024 1 commit
- support speculative execution for openai API (#48) · 23950056
  parasol-aser authored Jan 25, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  23950056
24 Jan, 2024 3 commits
- add a batch llava example · 711d3435
  Lianmin Zheng authored Jan 24, 2024
  
  711d3435
- Fix llava & Fix multiprocessing · bef0b359
  Lianmin Zheng authored Jan 24, 2024
  
  bef0b359
- Llava-hd Support (#92) · c6576e82
  shiyi.c_98 authored Jan 24, 2024
```
Co-authored-by: Haotian Liu <liuhaotian.cn@gmail.com>
```
  c6576e82
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
21 Jan, 2024 2 commits
- Add an async example (#37) · 3f5c2f4c
  Ying Sheng authored Jan 21, 2024
  
  3f5c2f4c
- Disk FSM cache and adjust code. (#63) · ca13f3b8
  Liangsheng Yin authored Jan 21, 2024
  
  ca13f3b8
18 Jan, 2024 2 commits
- Add a llava example (#47) · 98a3e8ef
  Lianmin Zheng authored Jan 18, 2024
  
  98a3e8ef
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
17 Jan, 2024 3 commits
- Improve docs & Rename Gemini -> VertexAI (#19) · bf51ddc6
  Lianmin Zheng authored Jan 17, 2024
  
  bf51ddc6
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
- Improve docs (#17) · c4707f1b
  Lianmin Zheng authored Jan 16, 2024
  
  c4707f1b
16 Jan, 2024 1 commit
- Improve Readme (#10) · 46b7ea7c
  Lianmin Zheng authored Jan 15, 2024
  
  46b7ea7c
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081