Commits · 686f5e321096f3a843a23a89fa4a3f28e586c26f · kecinstone / 2024pra-vllm

16 Nov, 2023 1 commit
- Return usage for openai streaming requests (#1663) · 686f5e32
  Iskren Ivov Chernev authored Nov 17, 2023
  
  686f5e32
30 Oct, 2023 1 commit
- Add support for `spaces_between_special_tokens` · 7013a801
  Dan Lord authored Oct 30, 2023
  
  7013a801
28 Sep, 2023 1 commit
- Add `skip_special_tokens` sampling params (#1186) · 20f7cc4c
  Dan Lord authored Sep 27, 2023
  
  20f7cc4c
24 Sep, 2023 1 commit
- Align `max_tokens` behavior with openai (#852) · bbbf8656
  Wen Sun authored Sep 24, 2023
  
  bbbf8656
21 Sep, 2023 1 commit
- feat: support stop_token_ids parameter. (#1097) · f98b745a
  Ricardo Lu authored Sep 22, 2023
  
  f98b745a
11 Aug, 2023 1 commit
- Supports tokens and arrays of tokens as inputs to the OpenAI completion API (#715) · e06f504a
  WanMok authored Aug 11, 2023
  
  e06f504a
03 Jul, 2023 3 commits
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
- Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573
  Michele Catalano authored Jul 03, 2023
```
* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  0bd2a573
- feat: add ChatCompletion endpoint in OpenAI demo server. (#330) · 49b26e2c
  Ricardo Lu authored Jul 03, 2023
  
  49b26e2c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
24 May, 2023 1 commit
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7