Commits · d6fa1be3a8ef71fa16f74afdc5d07d27cbf725b1 · kecinstone / 2024pra-vllm

"googlemock/include/gmock/gmock-actions.h" did not exist on "d370f85b0236b9d4ee9be91b4ae812f6bf6bb0dd"

03 Jul, 2023 4 commits
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
- [Fix] Better error message for batched prompts (#342) · 0ffded81
  Zhuohan Li authored Jul 03, 2023
  
  0ffded81
- Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573
  Michele Catalano authored Jul 03, 2023
```
* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  0bd2a573
- feat: add ChatCompletion endpoint in OpenAI demo server. (#330) · 49b26e2c
  Ricardo Lu authored Jul 03, 2023
  
  49b26e2c
01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
30 Jun, 2023 1 commit
- [Fix] Weight loading for GPTBigCode (#313) · 598dc4b7
  Zhuohan Li authored Jun 29, 2023
  
  598dc4b7
29 Jun, 2023 1 commit
- [Fix] Do not pin memory when in WSL (#312) · 85de0934
  Zhuohan Li authored Jun 29, 2023
  
  85de0934
28 Jun, 2023 4 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- remove floats == 0 comparison (#285) · 425040d4
  Lily Liu authored Jun 28, 2023
  
  425040d4
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
- Add LLM.set_tokenizer (#283) · bdd6b4c8
  Jishnu Ray Chowdhury authored Jun 28, 2023
  
  bdd6b4c8
27 Jun, 2023 1 commit
- expand coverage of gpt2 model loading (#271) · 4026a049
  twaka authored Jun 27, 2023
  
  4026a049
26 Jun, 2023 3 commits
- [BugFix] Fix a bug in counting running sequences (#266) · 526df28f
  Woosuk Kwon authored Jun 26, 2023
  
  526df28f
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
- Compatible with Decapoda Research llama hf version (#251) · 471a7a45
  BasicCoder authored Jun 27, 2023
  
  471a7a45
25 Jun, 2023 1 commit
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
22 Jun, 2023 4 commits
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
- Bump up version to 0.1.1 (#204) · 83658c8a
  Zhuohan Li authored Jun 22, 2023
  
  83658c8a
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
19 Jun, 2023 1 commit
- [Minor] Fix CompletionOutput.__repr__ (#157) · 7e2a913c
  Woosuk Kwon authored Jun 18, 2023
  
  7e2a913c
18 Jun, 2023 2 commits
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 2 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15