Commits · 58a072be15a4e36bee006d1c9a962e527819cf18 · kecinstone / 2024pra-vllm

26 Jul, 2023 2 commits
- [Fix] Add model sequence length into model config (#575) · 58a072be
  Zhuohan Li authored Jul 25, 2023
  
  58a072be
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
20 Jul, 2023 1 commit
- fix: enable trust-remote-code in api server & benchmark. (#509) · 8c4b2592
  Ricardo Lu authored Jul 20, 2023
  
  8c4b2592
08 Jul, 2023 1 commit
- Sort the outputs before return (#402) · b6fbb9a5
  Woosuk Kwon authored Jul 08, 2023
  
  b6fbb9a5
07 Jul, 2023 3 commits
- Add trust-remote-code flag to handle remote tokenizers (#364) · a945fcc2
  codethazine authored Jul 07, 2023
  
  a945fcc2
- [Fix] Change /generate response-type to json for non-streaming (#374) · be54f8e5
  Nicolas Frenay authored Jul 06, 2023
  
  be54f8e5
- fix: only response [DONE] once when streaming response. (#378) · b396cb49
  Ricardo Lu authored Jul 07, 2023
  
  b396cb49
05 Jul, 2023 1 commit
- [Server] use fastchat.model.model_adapter.get_conversation_template method to... · 3d64cf01
  akxxsb authored Jul 05, 2023
```
[Server] use fastchat.model.model_adapter.get_conversation_template method to get model template (#357)
```
  3d64cf01
04 Jul, 2023 1 commit
- [Server] Add option to specify chat template for chat endpoint (#345) · 98fe8cb5
  Zhuohan Li authored Jul 03, 2023
  
  98fe8cb5
03 Jul, 2023 5 commits
- [Quality] Add CI for formatting (#343) · 42e0c1df
  Zhuohan Li authored Jul 03, 2023
  
  42e0c1df
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
- [Fix] Better error message for batched prompts (#342) · 0ffded81
  Zhuohan Li authored Jul 03, 2023
  
  0ffded81
- Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573
  Michele Catalano authored Jul 03, 2023
```
* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  0bd2a573
- feat: add ChatCompletion endpoint in OpenAI demo server. (#330) · 49b26e2c
  Ricardo Lu authored Jul 03, 2023
  
  49b26e2c
28 Jun, 2023 3 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
- Add LLM.set_tokenizer (#283) · bdd6b4c8
  Jishnu Ray Chowdhury authored Jun 28, 2023
  
  bdd6b4c8
22 Jun, 2023 1 commit
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15