Commits · 4851c202bbfb5dadc5a3b3b4409d3f083f4e8e90 · OpenDAS / vllm_cscc · GitLab

11 Sep, 2024 6 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Kernel][Misc] register ops to prevent graph breaks (#6917) · 73202dbe
  bnellnm authored Sep 11, 2024
```
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  73202dbe
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
- [Bugfix] Fix InternVL2 vision embeddings process with pipeline parallel (#8299) · 1230263e
  Isotr0py authored Sep 11, 2024
  
  1230263e
- [Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329) · e497b8ae
  Jee Jee Li authored Sep 11, 2024
  
  e497b8ae
10 Sep, 2024 2 commits
- [Bugfix] Fix missing `post_layernorm` in CLIP (#8155) · da1a844e
  Cyrus Leung authored Sep 10, 2024
  
  da1a844e
- [Misc] Fused MoE Marlin support for GPTQ (#8217) · 6cd5e5b0
  Dipika Sikka authored Sep 09, 2024
  
  6cd5e5b0
09 Sep, 2024 2 commits
- [Bugfix] Correct adapter usage for cohere and jamba (#8292) · f9b4a2d4
  Vladislav Kruglikov authored Sep 09, 2024
  
  f9b4a2d4
- add cutlass fa and support bloom nn layout · 82f1ffdf
  zhuwenwen authored Sep 09, 2024
  
  82f1ffdf
07 Sep, 2024 3 commits
- [Model][VLM] Decouple weight loading logic for `Paligemma` (#8269) · 36bf8150
  Isotr0py authored Sep 08, 2024
  
  36bf8150
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
06 Sep, 2024 1 commit
- [Model] Allow loading from original Mistral format (#8168) · 29f49cd6
  Patrick von Platen authored Sep 07, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  29f49cd6
05 Sep, 2024 2 commits
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860) · 8685ba1a
  manikandan.tm@zucisystems.com authored Sep 05, 2024
  
  8685ba1a
04 Sep, 2024 2 commits
- [Bugfix] remove post_layernorm in siglip (#8106) · d3311562
  wnma authored Sep 04, 2024
  
  d3311562
- [Model] Add Ultravox support for multiple audio chunks (#7963) · 2be8ec6e
  Peter Salas authored Sep 03, 2024
  
  2be8ec6e
03 Sep, 2024 1 commit
- [Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061) · ec266536
  Isotr0py authored Sep 03, 2024
  
  ec266536
02 Sep, 2024 2 commits
- [Bugfix] Fix internlm2 tensor parallel inference (#8055) · dd2a6a82
  Isotr0py authored Sep 02, 2024
  
  dd2a6a82
- [Model] Add Granite model (#7436) · f8d60145
  Shawn Tan authored Sep 01, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  f8d60145
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
31 Aug, 2024 1 commit
- [Bugfix] Fix import error in Phi-3.5-MoE (#8052) · d05f0a9d
  Cyrus Leung authored Aug 31, 2024
  
  d05f0a9d
30 Aug, 2024 5 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [VLM][Model] TP support for ViTs (#7186) · f97be32d
  Jungho Christopher Cho authored Aug 31, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f97be32d
- [Bugfix] Fix import error in Exaone model (#8034) · afd39a45
  Cyrus Leung authored Aug 30, 2024
  
  afd39a45
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
29 Aug, 2024 1 commit
- [VLM][Core] Fix exceptions on ragged NestedTensors (#7974) · 74d5543e
  Peter Salas authored Aug 28, 2024
  
  74d5543e
28 Aug, 2024 3 commits
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
- [Bugfix][VLM] Fix incompatibility between #7902 and #7230 (#7948) · ef9baee3
  Cyrus Leung authored Aug 28, 2024
  
  ef9baee3
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
27 Aug, 2024 3 commits
- [Model] Add multi-image input support for LLaVA-Next offline inference (#7230) · 5340a2dc
  zifeitong authored Aug 27, 2024
  
  5340a2dc
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766) · fc911880
  Dipika Sikka authored Aug 27, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  fc911880
- [Bugfix] Fix phi3v incorrect image_idx when using async engine (#7916) · b09c755b
  Isotr0py authored Aug 28, 2024
  
  b09c755b
25 Aug, 2024 2 commits
- [Model][VLM] Support multi-images inputs for Phi-3-vision models (#7783) · 8aaf3d53
  Isotr0py authored Aug 25, 2024
  
  8aaf3d53
- [Bugfix] Fix Phi-3v crash when input images are of certain sizes (#7840) · 80162c44
  zifeitong authored Aug 24, 2024
  
  80162c44
22 Aug, 2024 3 commits
- [Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830) · a3fce56b
  Abhinav Goyal authored Aug 22, 2024
  
  a3fce56b
- Revert "[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527)" (#7764) · aae74ef9
  Michael Goin authored Aug 21, 2024
  
  aae74ef9
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113