Commits · 4bb98f2190aaf408cb063df5184829fb54ee5f81 · OpenDAS / vllm_cscc

26 Sep, 2024 1 commit
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 2 commits

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding (#8047) · 01b6f9e1
Travis Johnson authored Sep 24, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
01b6f9e1

23 Sep, 2024 1 commit
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
20 Sep, 2024 1 commit
- [Bugfix][Core] Fix tekken edge case for mistral tokenizer (#8640) · b4e4eda9
  Patrick von Platen authored Sep 20, 2024
  
  b4e4eda9
18 Sep, 2024 1 commit
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
17 Sep, 2024 1 commit
- [Model] Add mistral function calling format to all models loaded with "mistral" format (#8515) · a54ed802
  Patrick von Platen authored Sep 17, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a54ed802
12 Sep, 2024 2 commits
- [Bugfix] Offline mode fix (#8376) · f2e263b8
  Joe Runde authored Sep 12, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  f2e263b8
- [Hotfix][VLM] Fixing max position embeddings for Pixtral (#8399) · 520ca380
  Roger Wang authored Sep 12, 2024
  
  520ca380
11 Sep, 2024 4 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Bugfix] Add missing attributes in mistral tokenizer (#8364) · 7015417f
  Cyrus Leung authored Sep 12, 2024
  
  7015417f
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
10 Sep, 2024 1 commit
- [Frontend] Clean up type annotations for mistral tokenizer (#8314) · 8c054b7a
  Cyrus Leung authored Sep 11, 2024
  
  8c054b7a
06 Sep, 2024 2 commits
- [Model] Allow loading from original Mistral format (#8168) · 29f49cd6
  Patrick von Platen authored Sep 07, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  29f49cd6
- [BugFix] Fix Granite model configuration (#8216) · baa54675
  Nick Hill authored Sep 05, 2024
  
  baa54675
04 Sep, 2024 1 commit
- [Frontend] Multimodal support in offline chat (#8098) · 855c262a
  Cyrus Leung authored Sep 04, 2024
  
  855c262a
02 Sep, 2024 2 commits
- [Core][Bugfix] Accept GGUF model without .gguf extension (#8056) · 4ca65a97
  Isotr0py authored Sep 02, 2024
  
  4ca65a97
- [Model] Add Granite model (#7436) · f8d60145
  Shawn Tan authored Sep 01, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  f8d60145
31 Aug, 2024 1 commit
- [Bugfix] Fix ModelScope models in v0.5.5 (#8037) · 4f5d8446
  Nicolò Lucchesi authored Aug 31, 2024
  
  4f5d8446
30 Aug, 2024 1 commit
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
27 Aug, 2024 1 commit
- [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739) · 6fc4e6e0
  Patrick von Platen authored Aug 27, 2024
  
  6fc4e6e0
22 Aug, 2024 2 commits
- [Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830) · a3fce56b
  Abhinav Goyal authored Aug 22, 2024
  
  a3fce56b
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
16 Aug, 2024 1 commit
- [Model] Align nemotron config with final HF state and fix lm-eval-small (#7611) · 44f26a94
  Michael Goin authored Aug 16, 2024
  
  44f26a94
13 Aug, 2024 1 commit
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
07 Aug, 2024 1 commit
- [Frontend] Gracefully handle missing chat template and fix CI failure (#7238) · 66d617e3
  Cyrus Leung authored Aug 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  66d617e3
05 Aug, 2024 1 commit
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
03 Aug, 2024 1 commit

[ Frontend ] Multiprocessing for OpenAI Server with `zeromq` (#6883) · ed812a73

Robert Shaw authored Aug 02, 2024


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

ed812a73

02 Aug, 2024 2 commits
- [ci][distributed] try to fix pp test (#7054) · 25235779
  youkaichao authored Aug 01, 2024
  
  25235779
- [Performance] Optimize `get_seqs` (#7051) · 6ce01f30
  Woosuk Kwon authored Aug 01, 2024
  
  6ce01f30
31 Jul, 2024 1 commit
- [mypy] Enable following imports for some directories (#6681) · da1f7cc1
  Cyrus Leung authored Jul 31, 2024
  
  da1f7cc1
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
26 Jul, 2024 1 commit
- [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611) · 07278c37
  Michael Goin authored Jul 26, 2024
  
  07278c37
23 Jul, 2024 2 commits
- Bump `transformers` version for Llama 3.1 hotfix and patch Chameleon (#6690) · 1bedf210
  Roger Wang authored Jul 23, 2024
  
  1bedf210
- [VLM][Model] Support image input for Chameleon (#6633) · 22fa2e35
  Roger Wang authored Jul 22, 2024
  
  22fa2e35
22 Jul, 2024 2 commits
- [Core] Support dynamically loading Lora adapter from HuggingFace (#6234) · 42c7f66a
  Jiaxin Shan authored Jul 22, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  42c7f66a
- [Model] Initial Support for Chameleon (#5770) · c9eef37f
  Roger Wang authored Jul 21, 2024
  
  c9eef37f
20 Jul, 2024 1 commit
- [Core] Allow specifying custom Executor (#6557) · 7bd82002
  Antoni Baum authored Jul 19, 2024
  
  7bd82002