Commits · ec2affa8ae2664db88df2ff0248219e355d6629a · OpenDAS / vllm_cscc

10 Aug, 2024 1 commit
- [Bugfix] Fix phi3v batch inference when images have different aspect ratio (#7392) · 4c5d8e8e
  Isotr0py authored Aug 11, 2024
  
  4c5d8e8e
09 Aug, 2024 3 commits
- [Model][Jamba] Mamba cache single buffer (#6739) · 07ab1607
  Mor Zusman authored Aug 09, 2024
```
Co-authored-by: Mor Zusman <morz@ai21.com>
```
  07ab1607
- [Bugfix] Fix speculative decoding with MLPSpeculator with padded vocabulary (#7218) · 99b4cf5f
  Travis Johnson authored Aug 08, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  99b4cf5f
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
08 Aug, 2024 1 commit
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
07 Aug, 2024 1 commit
- [Bugfix] Fix input processor for InternVL2 model (#7164) · b7645476
  Isotr0py authored Aug 08, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7645476
06 Aug, 2024 2 commits

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

[Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153) · 1f26efbb
Cyrus Leung authored Aug 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
1f26efbb

05 Aug, 2024 4 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Doc] [SpecDecode] Update MLPSpeculator documentation (#7100) · 789937af
  Thomas Parnell authored Aug 06, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  789937af
- [Model] SiglipVisionModel ported from transformers (#6942) · c0d8f163
  Jungho Christopher Cho authored Aug 05, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  c0d8f163
- [Model] Add multi-image support for minicpmv (#7122) · 7b86e7c9
  Alphi authored Aug 05, 2024
```
Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  7b86e7c9
04 Aug, 2024 1 commit
- [Model]Refactor MiniCPMV (#7020) · 179a6a36
  Jee Jee Li authored Aug 04, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  179a6a36
03 Aug, 2024 1 commit
- [Model] Refactor and decouple weight loading logic for InternVL2 model (#7067) · 0c25435d
  Isotr0py authored Aug 03, 2024
  
  0c25435d
01 Aug, 2024 6 commits
- [Misc] Support attention logits soft-capping with flash-attn (#7022) · 805a8a75
  Woosuk Kwon authored Aug 01, 2024
  
  805a8a75
- [Models] Support Qwen model with PP (#6974) · fc912e08
  Murali Andoorveedu authored Aug 01, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  fc912e08
- [Bugfix] Lower gemma's unloaded_params exception to warning (#7002) · f4fd390f
  Michael Goin authored Aug 01, 2024
  
  f4fd390f
- [Bugfix] Fix RMSNorm forward in InternViT attention qk_layernorm (#6992) · 2dd34371
  Isotr0py authored Aug 02, 2024
  
  2dd34371
- [Bugfix][Model] Skip loading lm_head weights if using tie_word_embeddings (#6758) · 630dd9e0
  Travis Johnson authored Jul 31, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  630dd9e0
- [Model] Pipeline parallel support for Qwen2 (#6924) · 1d2e7fb7
  xuyi authored Aug 01, 2024
  
  1d2e7fb7
31 Jul, 2024 4 commits
- [Bugfix] Support cpu offloading with fp8 quantization (#6960) · 460c1884
  Michael Goin authored Jul 31, 2024
  
  460c1884
- [Model] use FusedMoE layer in Jamba (#6935) · 2ee8d3ba
  Avshalom Manevich authored Jul 31, 2024
  
  2ee8d3ba
- [Bugfix] Fix feature size calculation for LLaVA-NeXT (#6982) · daed30c4
  Cyrus Leung authored Jul 31, 2024
  
  daed30c4
- [Bugfix] Clean up MiniCPM-V (#6939) · 2f4e108f
  Alphi authored Jul 31, 2024
```
Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2f4e108f
30 Jul, 2024 1 commit
- [Bugfix] Fix PaliGemma MMP (#6930) · c66c7f86
  Roger Wang authored Jul 30, 2024
  
  c66c7f86
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
27 Jul, 2024 2 commits
- [Model] Initial support for BLIP-2 (#5920) · 1ad86acf
  Cyrus Leung authored Jul 27, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  1ad86acf
- [Bugfix][Model] Jamba assertions and no chunked prefill by default for Jamba (#6784) · ed94e4f4
  tomeras91 authored Jul 27, 2024
  
  ed94e4f4
26 Jul, 2024 1 commit
- [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611) · 07278c37
  Michael Goin authored Jul 26, 2024
  
  07278c37
25 Jul, 2024 1 commit
- [Model] Adding support for MiniCPM-V (#4087) · 9e169a4c
  Alphi authored Jul 25, 2024
  
  9e169a4c
24 Jul, 2024 1 commit
- [Bugfix] Fix token padding for chameleon (#6724) · 0a740a11
  Roger Wang authored Jul 24, 2024
  
  0a740a11
23 Jul, 2024 4 commits
- Bump `transformers` version for Llama 3.1 hotfix and patch Chameleon (#6690) · 1bedf210
  Roger Wang authored Jul 23, 2024
  
  1bedf210
- [Model] Pipeline Parallel Support for DeepSeek v2 (#6519) · 507ef787
  Travis Johnson authored Jul 23, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  507ef787
- [VLM][Model] Support image input for Chameleon (#6633) · 22fa2e35
  Roger Wang authored Jul 22, 2024
  
  22fa2e35
- [Misc] Support FP8 kv cache scales from compressed-tensors (#6528) · 9e0b558a
  Michael Goin authored Jul 23, 2024
  
  9e0b558a
22 Jul, 2024 2 commits
- [Bugfix] Fix `vocab_size` field access in `llava_next.py` (#6624) · 89c1c6a1
  Jae-Won Chung authored Jul 22, 2024
  
  89c1c6a1
- [Model] Initial Support for Chameleon (#5770) · c9eef37f
  Roger Wang authored Jul 21, 2024
  
  c9eef37f
21 Jul, 2024 1 commit
- [Model] Refactor and decouple phi3v image embedding (#6621) · 25e778aa
  Isotr0py authored Jul 22, 2024
  
  25e778aa
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
19 Jul, 2024 1 commit
- [Misc] Small perf improvements (#6520) · 9ed82e70
  Antoni Baum authored Jul 19, 2024
  
  9ed82e70