Commits · 8bfaa4e31eb63d41499fec933e68969ebbedb01f · OpenDAS / vllm_cscc

09 Oct, 2024 3 commits
- [Bugfix] fix composite weight loading and EAGLE weight loading (#9160) · 8bfaa4e3
  Cyrus Leung authored Oct 09, 2024
  
  8bfaa4e3
- [Model] Remap FP8 kv_scale in CommandR and DBRX (#9174) · cdc72e3c
  Hui Liu authored Oct 08, 2024
  
  cdc72e3c
- support bitsandbytes quantization with more models (#9148) · 2f4117c3
  chenqianfzh authored Oct 08, 2024
  
  2f4117c3
07 Oct, 2024 3 commits
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
- [Core] Refactor GGUF parameters packing and forwarding (#8859) · f19da648
  Isotr0py authored Oct 07, 2024
  
  f19da648
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
06 Oct, 2024 1 commit
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
05 Oct, 2024 2 commits
- [Model] Support Gemma2 embedding model (#9004) · 15986f59
  Xin Yang authored Oct 04, 2024
  
  15986f59
- [Bugfix] Fixes Phi3v & Ultravox Multimodal EmbeddingInputs (#8979) · 53b3a330
  hhzhang16 authored Oct 04, 2024
  
  53b3a330
04 Oct, 2024 5 commits
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Model] add a bunch of supported lora modules for mixtral (#9008) · 9ade8bbc
  Prashant Gupta authored Oct 04, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  9ade8bbc
- [Bugfix] Reshape the dimensions of the input image embeddings in Qwen2VL (#9071) · 3d826d2c
  whyiug authored Oct 04, 2024
  
  3d826d2c
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
03 Oct, 2024 2 commits
- [Bugfix] Weight loading fix for OPT model (#9042) · 2838d6b3
  Domen Vreš authored Oct 04, 2024
```
Co-authored-by: dvres <dvres@fri.uni-lj.si>
```
  2838d6b3
- [Model] Adding Granite MoE. (#8206) · 19f0d257
  Shawn Tan authored Oct 02, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  19f0d257
01 Oct, 2024 3 commits
- [Doc] Update list of supported models (#8987) · 4f341bd4
  Cyrus Leung authored Oct 02, 2024
  
  4f341bd4
- [Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With... · 1fe0a426
  Alex Brooks authored Oct 01, 2024
```
[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With No Placeholders (#8991)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  1fe0a426
- [Bugfix] Fix Fuyu tensor parallel inference (#8986) · bc4eb65b
  Isotr0py authored Oct 01, 2024
  
  bc4eb65b
30 Sep, 2024 3 commits
- [Model] Expose InternVL2 max_dynamic_patch as a mm_processor_kwarg (#8946) · 2ae25f79
  Isotr0py authored Sep 30, 2024
  
  2ae25f79
- [Model][LoRA]LoRA support added for MiniCPMV2.6 (#8943) · 8e60afa1
  Jee Jee Li authored Sep 30, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8e60afa1
- [Model] support input embeddings for qwen2vl (#8856) · e01ab595
  whyiug authored Sep 30, 2024
  
  e01ab595
29 Sep, 2024 3 commits
- [Kernel][Model] Varlen prefill + Prefill chunking support for mamba kernels and Jamba model (#8533) · f13a07b1
  Mor Zusman authored Sep 30, 2024
  
  f13a07b1
- [Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199) · 3d49776b
  Jee Jee Li authored Sep 29, 2024
  
  3d49776b
- [Model] Support Qwen2.5-Math-RM-72B (#8896) · bc2ef1f7
  Zilin Zhu authored Sep 29, 2024
  
  bc2ef1f7
27 Sep, 2024 1 commit
- [Bugfix][VLM] Fix Fuyu batching inference with `max_num_seqs>1` (#8892) · 6d792d2f
  Isotr0py authored Sep 27, 2024
  
  6d792d2f
26 Sep, 2024 1 commit
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 7 commits
- [Misc] Support quantization of MllamaForCausalLM (#8822) · 7193774b
  Michael Goin authored Sep 25, 2024
  
  7193774b
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602
- [Misc] Support FP8 MoE for compressed-tensors (#8588) · 873edda6
  Michael Goin authored Sep 25, 2024
  
  873edda6
- [VLM][Bugfix] internvl with num_scheduler_steps > 1 (#8614) · 0c4d2ad5
  DefTruth authored Sep 26, 2024
  
  0c4d2ad5
- [Bugfix] load fc bias from config for eagle (#8790) · 3e073e66
  sohamparikh authored Sep 25, 2024
  
  3e073e66
- [Hardware][CPU] Enable mrope and support Qwen2-VL on CPU backend (#8770) · c2395367
  Isotr0py authored Sep 25, 2024
  
  c2395367
- [BugFix] Propagate 'trust_remote_code' setting in internvl and minicpmv (#8250) · e3dd0692
  zifeitong authored Sep 24, 2024
  
  e3dd0692
24 Sep, 2024 2 commits
- [Model] Expose Phi3v num_crops as a mm_processor_kwarg (#8658) · 8ff7ced9
  Alex Brooks authored Sep 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ff7ced9
- [Core][Model] Support loading weights by ID within models (#7931) · 3f06bae9
  Peter Salas authored Sep 24, 2024
  
  3f06bae9
23 Sep, 2024 2 commits
- [VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use... · f2bd246c
  Jani Monoses authored Sep 23, 2024
```
[VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use config.text_config.vocab_size (#8707)
```
  f2bd246c
- [Model] Support pp for qwen2-vl (#8696) · a79e5229
  Yanyi Liu authored Sep 23, 2024
  
  a79e5229
22 Sep, 2024 2 commits

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
Cyrus Leung authored Sep 22, 2024

06ed2815