Commits · d66ac62854e04c8fda83506dc93ef7971ebf593a · OpenDAS / vllm_cscc · GitLab

21 Sep, 2024 2 commits
- [dbrx] refactor dbrx experts to extend FusedMoe class (#8518) · 9dc7c6c7
  Divakar Verma authored Sep 21, 2024
  
  9dc7c6c7
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
20 Sep, 2024 3 commits
- [Bugfix] Fix incorrect llava next feature size calculation (#8496) · 0f961b3c
  zyddnys authored Sep 20, 2024
  
  0f961b3c
- [Model] Add OLMoE (#7922) · 3b63de93
  Niklas Muennighoff authored Sep 20, 2024
  
  3b63de93
- [Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571) · 18ae428a
  Amit Garg authored Sep 19, 2024
  
  18ae428a
18 Sep, 2024 3 commits
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
- [CI/Build] Update Ruff version (#8469) · 9d104b5b
  Aaron Pham authored Sep 18, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9d104b5b
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
17 Sep, 2024 2 commits
- [Bugfix] Fix TP > 1 for new granite (#8544) · 98f97133
  Joe Runde authored Sep 17, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  98f97133
- [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) · 1009e93c
  sroy745 authored Sep 17, 2024
  
  1009e93c
15 Sep, 2024 1 commit
- [Bugfix][Model] Fix Python 3.8 compatibility in Pixtral model by updating type annotations (#8490) · 3724d5f6
  Chris authored Sep 15, 2024
  
  3724d5f6
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 1 commit
- [Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 (#8442) · 06311e29
  Jee Jee Li authored Sep 13, 2024
  
  06311e29
12 Sep, 2024 6 commits
- [Bugfix] Fix weight loading issue by rename variable. (#8293) · a480939e
  Wenxiang authored Sep 13, 2024
  
  a480939e
- [Hotfix][Pixtral] Fix multiple images bugs (#8415) · d31174a4
  Patrick von Platen authored Sep 13, 2024
  
  d31174a4
- [Hotfix][Core][VLM] Disable chunked prefill by default and prefix caching for... · c1636945
  Roger Wang authored Sep 12, 2024
```
[Hotfix][Core][VLM] Disable chunked prefill by default and prefix caching for multimodal models (#8425)
```
  c1636945
- [Model] Support multiple images for qwen-vl (#8247) · c6202dae
  Alex Brooks authored Sep 12, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6202dae
- [Bugfix] Fix InternVL2 inference with various num_patches (#8375) · e56bf277
  Isotr0py authored Sep 13, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e56bf277
- [Gemma2] add bitsandbytes support for Gemma2 (#8338) · 1bf2dd9d
  Blueyo0 authored Sep 12, 2024
  
  1bf2dd9d
11 Sep, 2024 6 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Kernel][Misc] register ops to prevent graph breaks (#6917) · 73202dbe
  bnellnm authored Sep 11, 2024
```
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  73202dbe
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
- [Bugfix] Fix InternVL2 vision embeddings process with pipeline parallel (#8299) · 1230263e
  Isotr0py authored Sep 11, 2024
  
  1230263e
- [Misc] Skip loading extra bias for Qwen2-MOE GPTQ models (#8329) · e497b8ae
  Jee Jee Li authored Sep 11, 2024
  
  e497b8ae
10 Sep, 2024 2 commits
- [Bugfix] Fix missing `post_layernorm` in CLIP (#8155) · da1a844e
  Cyrus Leung authored Sep 10, 2024
  
  da1a844e
- [Misc] Fused MoE Marlin support for GPTQ (#8217) · 6cd5e5b0
  Dipika Sikka authored Sep 09, 2024
  
  6cd5e5b0
09 Sep, 2024 1 commit
- [Bugfix] Correct adapter usage for cohere and jamba (#8292) · f9b4a2d4
  Vladislav Kruglikov authored Sep 09, 2024
  
  f9b4a2d4
07 Sep, 2024 3 commits
- [Model][VLM] Decouple weight loading logic for `Paligemma` (#8269) · 36bf8150
  Isotr0py authored Sep 08, 2024
  
  36bf8150
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
06 Sep, 2024 1 commit
- [Model] Allow loading from original Mistral format (#8168) · 29f49cd6
  Patrick von Platen authored Sep 07, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  29f49cd6
05 Sep, 2024 2 commits
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860) · 8685ba1a
  manikandan.tm@zucisystems.com authored Sep 05, 2024
  
  8685ba1a
04 Sep, 2024 2 commits
- [Bugfix] remove post_layernorm in siglip (#8106) · d3311562
  wnma authored Sep 04, 2024
  
  d3311562
- [Model] Add Ultravox support for multiple audio chunks (#7963) · 2be8ec6e
  Peter Salas authored Sep 03, 2024
  
  2be8ec6e
03 Sep, 2024 1 commit
- [Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061) · ec266536
  Isotr0py authored Sep 03, 2024
  
  ec266536
02 Sep, 2024 2 commits
- [Bugfix] Fix internlm2 tensor parallel inference (#8055) · dd2a6a82
  Isotr0py authored Sep 02, 2024
  
  dd2a6a82
- [Model] Add Granite model (#7436) · f8d60145
  Shawn Tan authored Sep 01, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  f8d60145
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199