Commits · 7d2dcce175cec00bc1d127d6b3a5f1ef73a6ba3c · kecinstone / 2024pra-vllm

21 Feb, 2024 1 commit
- Support per-request seed (#2514) · 7d2dcce1
  Nick Hill authored Feb 21, 2024
  
  7d2dcce1
24 Jan, 2024 1 commit
- Added `include_stop_str_in_output` and `length_penalty` parameters to OpenAI API (#2562) · f1f6cc10
  Federico Galatolo authored Jan 24, 2024
  
  f1f6cc10
22 Jan, 2024 1 commit
- migrate pydantic from v1 to v2 (#2531) · 71d63ed7
  Jannis Schönleber authored Jan 22, 2024
  
  71d63ed7
19 Jan, 2024 1 commit
- refactor complemention api for readability (#2499) · dd7e8f5f
  Simon Mo authored Jan 18, 2024
  
  dd7e8f5f
03 Dec, 2023 1 commit
- add custom server params (#1868) · 60dc62dc
  Roy authored Dec 04, 2023
  
  60dc62dc
01 Dec, 2023 1 commit
- Support chat template and `echo` for chat API (#1756) · 66785cc0
  Adam Brusselback authored Nov 30, 2023
  
  66785cc0
27 Nov, 2023 1 commit
- Added echo function to OpenAI API server. (#1504) · 665cbcec
  Yunmo Chen authored Nov 27, 2023
  
  665cbcec
16 Nov, 2023 1 commit
- Return usage for openai streaming requests (#1663) · 686f5e32
  Iskren Ivov Chernev authored Nov 17, 2023
  
  686f5e32
30 Oct, 2023 1 commit
- Add support for `spaces_between_special_tokens` · 7013a801
  Dan Lord authored Oct 30, 2023
  
  7013a801
28 Sep, 2023 1 commit
- Add `skip_special_tokens` sampling params (#1186) · 20f7cc4c
  Dan Lord authored Sep 27, 2023
  
  20f7cc4c
24 Sep, 2023 1 commit
- Align `max_tokens` behavior with openai (#852) · bbbf8656
  Wen Sun authored Sep 24, 2023
  
  bbbf8656
21 Sep, 2023 1 commit
- feat: support stop_token_ids parameter. (#1097) · f98b745a
  Ricardo Lu authored Sep 22, 2023
  
  f98b745a
11 Aug, 2023 1 commit
- Supports tokens and arrays of tokens as inputs to the OpenAI completion API (#715) · e06f504a
  WanMok authored Aug 11, 2023
  
  e06f504a
03 Jul, 2023 3 commits
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
- Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573
  Michele Catalano authored Jul 03, 2023
```
* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  0bd2a573
- feat: add ChatCompletion endpoint in OpenAI demo server. (#330) · 49b26e2c
  Ricardo Lu authored Jul 03, 2023
  
  49b26e2c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
24 May, 2023 1 commit
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7