Commits · c894836108732d0cbb6fce15aeda8de1218a380d · kecinstone / 2024pra-vllm

09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
08 Jul, 2023 4 commits
- Don't try to load training_args.bin (#373) · 75beba29
  Fazlul Shahriar authored Jul 08, 2023
  
  75beba29
- Add trust_remote_code arg to get_config (#405) · ddfdf470
  Woosuk Kwon authored Jul 08, 2023
  
  ddfdf470
- Sort the outputs before return (#402) · b6fbb9a5
  Woosuk Kwon authored Jul 08, 2023
  
  b6fbb9a5
- avoid python list copy in sequence initialization (#401) · 2179e4f4
  Lily Liu authored Jul 08, 2023
  
  2179e4f4
07 Jul, 2023 3 commits
- Add trust-remote-code flag to handle remote tokenizers (#364) · a945fcc2
  codethazine authored Jul 07, 2023
  
  a945fcc2
- [Fix] Change /generate response-type to json for non-streaming (#374) · be54f8e5
  Nicolas Frenay authored Jul 06, 2023
  
  be54f8e5
- fix: only response [DONE] once when streaming response. (#378) · b396cb49
  Ricardo Lu authored Jul 07, 2023
  
  b396cb49
05 Jul, 2023 2 commits
- Bump up the version (#300) · 1c395b4e
  Woosuk Kwon authored Jul 04, 2023
  
  1c395b4e
- [Server] use fastchat.model.model_adapter.get_conversation_template method to... · 3d64cf01
  akxxsb authored Jul 05, 2023
```
[Server] use fastchat.model.model_adapter.get_conversation_template method to get model template (#357)
```
  3d64cf01
04 Jul, 2023 1 commit
- [Server] Add option to specify chat template for chat endpoint (#345) · 98fe8cb5
  Zhuohan Li authored Jul 03, 2023
  
  98fe8cb5
03 Jul, 2023 8 commits
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Fix an endless loop issue when engine_step throws a RuntimeError (#339) · 7717d083
  coolcloudcol authored Jul 04, 2023
  
  7717d083
- [Quality] Add CI for formatting (#343) · 42e0c1df
  Zhuohan Li authored Jul 03, 2023
  
  42e0c1df
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
- [Fix] Better error message for batched prompts (#342) · 0ffded81
  Zhuohan Li authored Jul 03, 2023
  
  0ffded81
- Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573
  Michele Catalano authored Jul 03, 2023
```
* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  0bd2a573
- feat: add ChatCompletion endpoint in OpenAI demo server. (#330) · 49b26e2c
  Ricardo Lu authored Jul 03, 2023
  
  49b26e2c
01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
30 Jun, 2023 1 commit
- [Fix] Weight loading for GPTBigCode (#313) · 598dc4b7
  Zhuohan Li authored Jun 29, 2023
  
  598dc4b7
29 Jun, 2023 1 commit
- [Fix] Do not pin memory when in WSL (#312) · 85de0934
  Zhuohan Li authored Jun 29, 2023
  
  85de0934
28 Jun, 2023 4 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- remove floats == 0 comparison (#285) · 425040d4
  Lily Liu authored Jun 28, 2023
  
  425040d4
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
- Add LLM.set_tokenizer (#283) · bdd6b4c8
  Jishnu Ray Chowdhury authored Jun 28, 2023
  
  bdd6b4c8
27 Jun, 2023 1 commit
- expand coverage of gpt2 model loading (#271) · 4026a049
  twaka authored Jun 27, 2023
  
  4026a049
26 Jun, 2023 3 commits
- [BugFix] Fix a bug in counting running sequences (#266) · 526df28f
  Woosuk Kwon authored Jun 26, 2023
  
  526df28f
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
- Compatible with Decapoda Research llama hf version (#251) · 471a7a45
  BasicCoder authored Jun 27, 2023
  
  471a7a45
25 Jun, 2023 1 commit
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
22 Jun, 2023 4 commits
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
- Bump up version to 0.1.1 (#204) · 83658c8a
  Zhuohan Li authored Jun 22, 2023
  
  83658c8a
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
19 Jun, 2023 1 commit
- [Minor] Fix CompletionOutput.__repr__ (#157) · 7e2a913c
  Woosuk Kwon authored Jun 18, 2023
  
  7e2a913c
18 Jun, 2023 2 commits
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c