Commits · 406d4cc480bbc01d41f34b83102548bae229671a · OpenDAS / vllm_cscc · GitLab

06 Nov, 2024 8 commits
- [Model][LoRA]LoRA support added for Qwen2VLForConditionalGeneration (#10022) · 406d4cc4
  Eric authored Nov 06, 2024
```
Signed-off-by: ericperfect <ericperfectttt@gmail.com>
```
  406d4cc4
- [Model] Add Idefics3 support (#9767) · a5bba7d2
  Jee Jee Li authored Nov 06, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>
```
  a5bba7d2
- [Model][LoRA]LoRA support added for LlamaEmbeddingModel (#10071) · 2003cc35
  Jee Jee Li authored Nov 06, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2003cc35
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
- [Bugfix] Gpt-j-6B patch kv_scale to k_scale path (#10063) · ea928f60
  arakowsk-amd authored Nov 05, 2024
```
Signed-off-by: Alex Rakowski <alex.rakowski@amd.com>
Signed-off-by: Alex Rakowski <182798202+arakowsk-amd@users.noreply.github.com>
```
  ea928f60
- [Model][OpenVINO] Fix regressions from #8346 (#10045) · ffc0f2b4
  Peter Salas authored Nov 05, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  ffc0f2b4
- [Misc] Sort the list of embedding models (#10037) · 82bfc38d
  Cyrus Leung authored Nov 06, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82bfc38d
- [Bugfix] Properly propagate trust_remote_code settings (#10047) · 43300bd9
  zifeitong authored Nov 05, 2024
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  43300bd9
05 Nov, 2024 3 commits
- [Model] Support quantization of PixtralHFTransformer for PixtralHF (#9921) · a53046b1
  Michael Goin authored Nov 05, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  a53046b1
- [Bugfix] Fixup Mamba (#10004) · ad233189
  Tyler Michael Smith authored Nov 04, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  ad233189
- [Core] Make encoder-decoder inputs a nested structure to be more composable (#9604) · bbc3619d
  Cyrus Leung authored Nov 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bbc3619d
04 Nov, 2024 4 commits
- [Model] factoring out MambaMixer out of Jamba (#8993) · 603a661a
  Mor Zusman authored Nov 04, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  603a661a
- [Misc]Reduce BNB static variable (#9987) · fb2716d6
  Jee Jee Li authored Nov 05, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fb2716d6
- [Bugfix] Fix MiniCPMV and Mllama BNB bug (#9917) · c49f0407
  Jee Jee Li authored Nov 04, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c49f0407
- [Model] Add support for H2OVL-Mississippi models (#9747) · 54597724
  shanshan wang authored Nov 03, 2024
```
Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  54597724
02 Nov, 2024 4 commits
- [bugfix] fix tsts (#9959) · 3bb4befe
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3bb4befe
- [torch.compile] Adding torch compile to vision-language models (#9946) · ae5279a1
  Yongzao authored Nov 03, 2024
  
  ae5279a1
- [bugfix] fix chatglm dummy_data_for_glmv (#9955) · 74b529ce
  youkaichao authored Nov 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  74b529ce
- [Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559) · a78dd330
  sroy745 authored Nov 01, 2024
  
  a78dd330
01 Nov, 2024 4 commits
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
- [Model] Support bitsandbytes for MiniCPMV (#9891) · 93a76dd2
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  93a76dd2
- [torch.compile] rework test plans (#9866) · 566cd277
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  566cd277
31 Oct, 2024 2 commits
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
- [Model] Support quantization of Qwen2VisionTransformer (#9817) · d087bf86
  Michael Goin authored Oct 31, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d087bf86
30 Oct, 2024 1 commit
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
29 Oct, 2024 5 commits
- [Bugfix] Fix prefix strings for quantized VLMs (#9772) · bc73e982
  Michael Goin authored Oct 29, 2024
  
  bc73e982
- [Model] Add LlamaEmbeddingModel as an embedding Implementation of LlamaModel (#9806) · ac3d748d
  Junichi Sato authored Oct 30, 2024
  
  ac3d748d
- [Model] Add BNB quantization support for Mllama (#9720) · 09500f7d
  Isotr0py authored Oct 29, 2024
  
  09500f7d
- [Bugfix] Use temporary directory in registry (#9721) · eae3d481
  Cyrus Leung authored Oct 29, 2024
  
  eae3d481
- [Model][LoRA]LoRA support added for Qwen (#9622) · 7a4df5f2
  Jee Jee Li authored Oct 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7a4df5f2
28 Oct, 2024 5 commits
- [torch.compile] add deepseek v2 compile (#9775) · 76ed5340
  youkaichao authored Oct 28, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  76ed5340
- Adding "torch compile" annotations to moe models (#9758) · aa0addb3
  Yongzao authored Oct 29, 2024
  
  aa0addb3
- [Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075
  litianjian authored Oct 29, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f8d8075
- [torch.compile] support moe models (#9632) · 32176fee
  youkaichao authored Oct 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  32176fee
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
26 Oct, 2024 1 commit
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
25 Oct, 2024 1 commit
- [Model] add a lora module for granite 3.0 MoE models (#9673) · a6f37218
  Will Johnson authored Oct 25, 2024
  
  a6f37218
24 Oct, 2024 2 commits
- [Bugfix] Remove xformers requirement for Pixtral (#9597) · c91ed47c
  Michael Goin authored Oct 24, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  c91ed47c
- [Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650) · 722d46ed
  Alex Brooks authored Oct 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  722d46ed