Commits · 4d31cd424bdd5935cefa8f03e137bba127be31dd · OpenDAS / vllm_cscc

14 Oct, 2024 2 commits
- [Frontend] merge beam search implementations (#9296) · 4d31cd42
  Brendan Wong authored Oct 14, 2024
  
  4d31cd42
- [Model] Molmo vLLM Integration (#9016) · dfe43a20
  Reza Salehi authored Oct 14, 2024
```
Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  dfe43a20
12 Oct, 2024 1 commit
- [BugFix] Fix tool call finish reason in streaming case (#9209) · ec10cb85
  Maximilien de Bayser authored Oct 11, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  ec10cb85
09 Oct, 2024 2 commits
- [CI/Build] mypy: check vllm/entrypoints (#9194) · cdca8994
  Russell Bryant authored Oct 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cdca8994
- [Bugfix] Access `get_vocab` instead of `vocab` in tool parsers (#9188) · cfaa6008
  Cyrus Leung authored Oct 09, 2024
  
  cfaa6008
08 Oct, 2024 4 commits
- [Bugfix] fix OpenAI API server startup with --disable-frontend-multiprocessing (#8537) · 9a94ca4a
  Daniele authored Oct 08, 2024
  
  9a94ca4a
- [Frontend] Add Early Validation For Chat Template / Tool Call Parser (#9151) · 069d3bd8
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  069d3bd8
- [Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) · a3691b6b
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  a3691b6b
- [Frontend] API support for beam search for MQLLMEngine (#9117) · 8c746226
  Brendan Wong authored Oct 07, 2024
  
  8c746226
07 Oct, 2024 2 commits
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
06 Oct, 2024 3 commits
- [Bugfix] fix tool_parser error handling when serve a model not support it (#8709) · fdf59d30
  Yanyi Liu authored Oct 06, 2024
  
  fdf59d30
- [Misc] Remove user-facing error for removed VLM args (#9104) · f22619fe
  Cyrus Leung authored Oct 06, 2024
  
  f22619fe
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
04 Oct, 2024 2 commits
- Adds truncate_prompt_tokens param for embeddings creation (#8999) · 0dcc8cbe
  Flávia Béo authored Oct 04, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
```
  0dcc8cbe
- [Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405) · 3dbb215b
  代君 authored Oct 04, 2024
  
  3dbb215b
03 Oct, 2024 1 commit
- [BugFix] Enforce Mistral ToolCall id constraint when using the Mistral tool call parser (#9020) · 83caf35e
  Guillaume Calmettes authored Oct 03, 2024
  
  83caf35e
01 Oct, 2024 2 commits
- [Core] [Frontend] Priority scheduling for embeddings and in the OpenAI-API (#8965) · 35bd2151
  Sebastian Schoennenbeck authored Oct 01, 2024
  
  35bd2151
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
29 Sep, 2024 1 commit
- [Frontend] Added support for HF's new `continue_final_message` parameter (#8942) · 6c9ba48f
  danieljannai21 authored Sep 29, 2024
  
  6c9ba48f
28 Sep, 2024 1 commit
- [Frontend] Make beam search emulator temperature modifiable (#8928) · 090e945e
  Edouard B. authored Sep 28, 2024
```
Co-authored-by: Eduard Balzin <nfunctor@yahoo.fr>
```
  090e945e
27 Sep, 2024 2 commits
- [Core] rename`PromptInputs` and `inputs` (#8876) · 3b00b9c2
  Cyrus Leung authored Sep 27, 2024
  
  3b00b9c2
- [Feature] Add support for Llama 3.1 and 3.2 tool use (#8343) · 344cd2b6
  Maximilien de Bayser authored Sep 26, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  344cd2b6
26 Sep, 2024 3 commits
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
- fix validation: Only set tool_choice `auto` if at least one tool is provided (#8568) · ee2da3e9
  Chirag Jain authored Sep 27, 2024
  
  ee2da3e9
- [Bugfix] Include encoder prompts len to non-stream api usage response (#8861) · 93d364da
  Pernekhan Utemuratov authored Sep 26, 2024
  
  93d364da
25 Sep, 2024 5 commits
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602
- Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) · 4f1ba084
  Simon Mo authored Sep 25, 2024
  
  4f1ba084
- rename PromptInputs and inputs with backward compatibility (#8760) · 28e1299e
  Cyrus Leung authored Sep 26, 2024
  
  28e1299e
- [Frontend] OpenAI server: propagate usage accounting to FastAPI middleware layer (#8672) · 1ac3de09
  Adam Tilghman authored Sep 25, 2024
  
  1ac3de09
- [Core] Adding Priority Scheduling (#5958) · 6da1ab6b
  Archit Patke authored Sep 24, 2024
  
  6da1ab6b
24 Sep, 2024 3 commits
- [Frontend] Batch inference for llm.chat() API (#8648) · 2529d09b
  Andy authored Sep 24, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  2529d09b
- Revert "[Core] Rename `PromptInputs` to `PromptType`, and `inputs` to `prompt`" (#8750) · 3185fb0c
  Simon Mo authored Sep 23, 2024
  
  3185fb0c
- re-implement beam search on top of vllm core (#8726) · 0250dd68
  youkaichao authored Sep 23, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  0250dd68
23 Sep, 2024 1 commit
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
21 Sep, 2024 1 commit
- [Core] Rename `PromptInputs` and `inputs`(#8673) · 0057894e
  Cyrus Leung authored Sep 21, 2024
  
  0057894e
20 Sep, 2024 2 commits
- [Bugfix] Config got an unexpected keyword argument 'engine' (#8556) · 2874bac6
  Pastel！ authored Sep 21, 2024
  
  2874bac6
- [Core] Support Lora lineage and base model metadata management (#6315) · 260d40b5
  Jiaxin Shan authored Sep 19, 2024
  
  260d40b5
18 Sep, 2024 2 commits

[BugFix] Nonzero exit code if MQLLMEngine startup fails (#8572) · d9cd78eb
Nick Hill authored Sep 18, 2024

d9cd78eb

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8