Commits · 571841b7fcc67f8b1d171522f6249ed4224033e1 · OpenDAS / vllm_cscc · GitLab

24 Nov, 2024 1 commit

[doc] update the code to add models (#10603) · e4fbb144

youkaichao authored Nov 24, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e4fbb144

19 Nov, 2024 1 commit
- Add openai.beta.chat.completions.parse example to structured_outputs.rst (#10433) · 74f8c2cf
  Michael Goin authored Nov 18, 2024
  
  74f8c2cf
18 Nov, 2024 2 commits
- [Doc] Add documentation for Structured Outputs (#9943) · 31894a21
  ismael-dm authored Nov 18, 2024
```
Signed-off-by: ismael-dm <ismaeldm99@gmail.com>
```
  31894a21
- [Doc] Update doc for LoRA support in GLM-4V (#10425) · 4186be81
  B-201 authored Nov 18, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  4186be81
16 Nov, 2024 1 commit
- [doc] add doc for the plugin system (#10372) · 755b8535
  youkaichao authored Nov 15, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  755b8535
15 Nov, 2024 2 commits
- [Misc] Consolidate pooler config overrides (#10351) · 2ac6d0e7
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ac6d0e7
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
13 Nov, 2024 4 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [Model][LoRA]LoRA support added for idefics3 (#10281) · d909acf9
  B-201 authored Nov 13, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  d909acf9
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1
- [Model] Add support for Qwen2-VL video embeddings input & multiple image... · 3945c823
  电脑星人 authored Nov 13, 2024
```
[Model] Add support for Qwen2-VL video embeddings input & multiple image embeddings input with varied resolutions (#10221)
Signed-off-by: imkero <kerorek@outlook.com>
```
  3945c823
08 Nov, 2024 1 commit
- [Doc] Update FAQ links in spec_decode.rst (#9662) · 40d0e741
  whyiug authored Nov 08, 2024
```
Signed-off-by: whyiug <whyiug@hotmail.com>
```
  40d0e741
06 Nov, 2024 3 commits
- [Model][LoRA]LoRA support added for Qwen2VLForConditionalGeneration (#10022) · 406d4cc4
  Eric authored Nov 06, 2024
```
Signed-off-by: ericperfect <ericperfectttt@gmail.com>
```
  406d4cc4
- [Model] Add Idefics3 support (#9767) · a5bba7d2
  Jee Jee Li authored Nov 06, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>
```
  a5bba7d2
- [Model][LoRA]LoRA support added for LlamaEmbeddingModel (#10071) · 2003cc35
  Jee Jee Li authored Nov 06, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2003cc35
04 Nov, 2024 2 commits
- [Doc] Update VLM doc about loading from local files (#9999) · 6e056bcf
  Roger Wang authored Nov 04, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6e056bcf
- [Model] Add support for H2OVL-Mississippi models (#9747) · 54597724
  shanshan wang authored Nov 03, 2024
```
Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  54597724
02 Nov, 2024 1 commit

[Docs] Update Granite 3.0 models in supported models table (#9930) · eed92f12

Nick Hill authored Nov 02, 2024


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

eed92f12

01 Nov, 2024 4 commits
- [Frontend] Use a proper chat template for VLM2Vec (#9912) · ba0d8920
  Cyrus Leung authored Nov 01, 2024
  
  ba0d8920
- [Frontend] Chat-based Embeddings API (#9759) · 06386a64
  Cyrus Leung authored Nov 01, 2024
  
  06386a64
- [Doc] Update multi-input support (#9906) · d3aa2a8b
  Cyrus Leung authored Nov 01, 2024
  
  d3aa2a8b
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
31 Oct, 2024 1 commit
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
29 Oct, 2024 1 commit
- [Doc] fix third-party model example (#9771) · c5d7fb9d
  Russell Bryant authored Oct 28, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c5d7fb9d
26 Oct, 2024 1 commit
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
24 Oct, 2024 3 commits
- [Doc] Move additional tips/notes to the top (#9647) · b979143d
  Cyrus Leung authored Oct 24, 2024
  
  b979143d
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
23 Oct, 2024 2 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 2 commits
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
- [Doc] Use shell code-blocks and fix section headers (#9508) · f7db5f0f
  Rafael Vasquez authored Oct 22, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  f7db5f0f
21 Oct, 2024 1 commit
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
18 Oct, 2024 2 commits
- [Model] Support Pixtral models in the HF Transformers format (#9036) · 3921a2f2
  Michael Goin authored Oct 18, 2024
  
  3921a2f2
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
17 Oct, 2024 1 commit

[Core] Deprecating block manager v1 and make block manager v2 default (#8704) · 81ede99c

Kuntai Du authored Oct 17, 2024

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

81ede99c

16 Oct, 2024 3 commits
- [Model][Bugfix] Add FATReLU activation and support for openbmb/MiniCPM-S-1B-sft (#9396) · 5b8a1fde
  Junhao Li authored Oct 16, 2024
  
  5b8a1fde
- [Misc] Consolidate example usage of OpenAI client for multimodal models (#9412) · 59230ef3
  Roger Wang authored Oct 16, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59230ef3
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e
15 Oct, 2024 1 commit
- [Doc] Fix code formatting in spec_decode.rst (#9348) · 8e836d98
  Michael Goin authored Oct 15, 2024
  
  8e836d98