Commits · 090e945e36cfe849b484db5414f64df96e97d678 · OpenDAS / vllm_cscc · GitLab

28 Sep, 2024 1 commit
- [Frontend] Make beam search emulator temperature modifiable (#8928) · 090e945e
  Edouard B. authored Sep 28, 2024
```
Co-authored-by: Eduard Balzin <nfunctor@yahoo.fr>
```
  090e945e
27 Sep, 2024 1 commit
- [Core] rename`PromptInputs` and `inputs` (#8876) · 3b00b9c2
  Cyrus Leung authored Sep 27, 2024
  
  3b00b9c2
25 Sep, 2024 3 commits
- Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) · 4f1ba084
  Simon Mo authored Sep 25, 2024
  
  4f1ba084
- rename PromptInputs and inputs with backward compatibility (#8760) · 28e1299e
  Cyrus Leung authored Sep 26, 2024
  
  28e1299e
- [Core] Adding Priority Scheduling (#5958) · 6da1ab6b
  Archit Patke authored Sep 24, 2024
  
  6da1ab6b
24 Sep, 2024 3 commits
- [Frontend] Batch inference for llm.chat() API (#8648) · 2529d09b
  Andy authored Sep 24, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  2529d09b
- Revert "[Core] Rename `PromptInputs` to `PromptType`, and `inputs` to `prompt`" (#8750) · 3185fb0c
  Simon Mo authored Sep 23, 2024
  
  3185fb0c
- re-implement beam search on top of vllm core (#8726) · 0250dd68
  youkaichao authored Sep 23, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  0250dd68
23 Sep, 2024 1 commit
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
21 Sep, 2024 1 commit
- [Core] Rename `PromptInputs` and `inputs`(#8673) · 0057894e
  Cyrus Leung authored Sep 21, 2024
  
  0057894e
17 Sep, 2024 2 commits
- [Model] Add mistral function calling format to all models loaded with "mistral" format (#8515) · a54ed802
  Patrick von Platen authored Sep 17, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a54ed802
- [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) · 1009e93c
  sroy745 authored Sep 17, 2024
  
  1009e93c
12 Sep, 2024 1 commit
- [Core] Add engine option to return only deltas or final output (#7381) · 551ce010
  Nick Hill authored Sep 12, 2024
  
  551ce010
10 Sep, 2024 1 commit
- [Frontend] Clean up type annotations for mistral tokenizer (#8314) · 8c054b7a
  Cyrus Leung authored Sep 11, 2024
  
  8c054b7a
07 Sep, 2024 1 commit
- [misc] [doc] [frontend] LLM torch profiler support (#7943) · 12dd7158
  William Lin authored Sep 06, 2024
  
  12dd7158
06 Sep, 2024 1 commit
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
04 Sep, 2024 1 commit
- [Frontend] Multimodal support in offline chat (#8098) · 855c262a
  Cyrus Leung authored Sep 04, 2024
  
  855c262a
27 Aug, 2024 2 commits
- [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739) · 6fc4e6e0
  Patrick von Platen authored Aug 27, 2024
  
  6fc4e6e0
- [Core] Asynchronous Output Processor (#7049) · 2eedede8
  Megha Agarwal authored Aug 26, 2024
```
Co-authored-by: Alexander Matveev <alexm@neuralmagic.com>
```
  2eedede8
21 Aug, 2024 2 commits
- [Bugfix] chat method add_generation_prompt param (#7734) · d3c002ea
  Brian Li authored Aug 22, 2024
  
  d3c002ea
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
16 Aug, 2024 2 commits

support tqdm in notebooks (#7510) · ec724a72
fzyzcjy authored Aug 17, 2024

ec724a72

Chat method for offline llm (#5049) · 3b19e39d

nunjunj authored Aug 16, 2024

Co-authored-by: nunjunj <ray@g-3ff9f30f2ed650001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-1df6075697c3f0001.c.vllm-405802.internal>
Co-authored-by: nunjunj <ray@g-c5a2c23abc49e0001.c.vllm-405802.internal>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b19e39d

09 Aug, 2024 1 commit
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
06 Aug, 2024 1 commit

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

04 Aug, 2024 1 commit
- Support for guided decoding for offline LLM (#6878) · 654bc5ca
  Yihuan Bu authored Aug 03, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  654bc5ca
22 Jul, 2024 1 commit
- [Frontend] Refactor prompt processing (#4028) · 739b61a3
  Cyrus Leung authored Jul 23, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  739b61a3
18 Jul, 2024 1 commit
- [core][model] yet another cpu offload implementation (#6496) · 1c27d25f
  youkaichao authored Jul 17, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  1c27d25f
09 Jul, 2024 1 commit

[CORE] Adding support for insertion of soft-tuned prompts (#4645) · 4d6ada94

Swapnil Parekh authored Jul 09, 2024


Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

4d6ada94

03 Jul, 2024 1 commit

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

12 Jun, 2024 1 commit
- [Frontend] Add "input speed" to tqdm postfix alongside output speed (#5425) · 7d19de2e
  Michael Goin authored Jun 12, 2024
  
  7d19de2e
06 Jun, 2024 1 commit
- [Frontend] enable passing multiple LoRA adapters at once to generate() (#5300) · 828da0d4
  Matthew Goldey authored Jun 06, 2024
  
  828da0d4
05 Jun, 2024 1 commit
- [BugFix] Apply get_cached_tokenizer to the tokenizer setter of LLM (#5207) · eb8fcd26
  DriverSong authored Jun 06, 2024
```
Co-authored-by: qiujiawei9 <qiujiawei9@jd.com>
```
  eb8fcd26
03 Jun, 2024 1 commit
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [BugFix] Prevent `LLM.encode` for non-generation Models (#5184) · 044793d8
  Robert Shaw authored Jun 01, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  044793d8
30 May, 2024 1 commit
- [Doc] Use intersphinx and update entrypoints docs (#5125) · a9bcc7af
  Cyrus Leung authored May 31, 2024
  
  a9bcc7af
28 May, 2024 1 commit
- [Core] Consolidate prompt arguments to LLM engines (#4328) · 5ae5ed1e
  Cyrus Leung authored May 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  5ae5ed1e
11 May, 2024 1 commit
- [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) · e254497b
  Chang Su authored May 11, 2024
  
  e254497b
09 May, 2024 1 commit
- [Frontend] add tok/s speed metric to llm class when using tqdm (#4400) · 16bc0a09
  Mahmoud Ashraf authored May 09, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  16bc0a09
03 May, 2024 1 commit
- [Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518) · 3521ba4f
  SangBin Cho authored May 04, 2024
  
  3521ba4f