Commits · bf0e382e16065edebbbb414f7889d31523a569e1 · OpenDAS / vllm_cscc · GitLab

07 Dec, 2024 2 commits
- [Model] Composite weight loading for multimodal Qwen2 (#10944) · bf0e382e
  Cyrus Leung authored Dec 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf0e382e
- [3/N] Support and implement merged input processor for LLaVA model (#10676) · 955fa953
  Cyrus Leung authored Dec 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  955fa953
04 Dec, 2024 1 commit
- [Model] Consolidate ViTs attention implementation without mask (#10893) · 10398b47
  Isotr0py authored Dec 05, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  10398b47
03 Dec, 2024 3 commits
- [Misc] Remove deprecated names (#10817) · 3257d449
  Cyrus Leung authored Dec 03, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3257d449
- [torch.compile] remove compilation_context and simplify code (#10838) · dc5ce861
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dc5ce861
- [Model] support bitsandbytes quantization with minicpm model (#10842) · d746268e
  zixuanzhang226 authored Dec 02, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  d746268e
02 Dec, 2024 3 commits
- [Model] Add TP and BNB quantization support to LlavaMultiModalProjector (#10834) · 4c05edb3
  Isotr0py authored Dec 03, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4c05edb3
- [misc] remove xverse modeling file (#10814) · 63a16417
  youkaichao authored Dec 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  63a16417
- [Model] Add BNB support to Llava and Pixtral-HF (#10795) · b18c9bba
  Isotr0py authored Dec 02, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b18c9bba
01 Dec, 2024 2 commits
- [Misc] Rename embedding classes to pooling (#10801) · d2f058e7
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f058e7
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
30 Nov, 2024 2 commits
- [Interleaved ATTN] Support for Mistral-8B (#10591) · e7cfc4ef
  Patrick von Platen authored Nov 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  e7cfc4ef
- [Model] Refactor Molmo weights loading to use AutoWeightsLoader (#10771) · 16ee07f2
  Isotr0py authored Nov 30, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  16ee07f2
29 Nov, 2024 2 commits
- [Bugfix] Fix Idefics3 bug (#10778) · 3132aac0
  Jee Jee Li authored Nov 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3132aac0
- [Model] Clean up MiniCPMV (#10751) · fa6ecb9a
  Cyrus Leung authored Nov 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fa6ecb9a
28 Nov, 2024 3 commits
- [Model] Add Internlm2 LoRA support (#5064) · c83919c7
  Isotr0py authored Nov 29, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c83919c7
- [Model] Added GLM-4 series hf format model support vllm==0.6.4 (#10561) · 5fc5ce0f
  sixgod authored Nov 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5fc5ce0f
- [Model] support bitsandbytes quantization with minicpm3 model (#10682) · 70dc14fb
  zixuanzhang226 authored Nov 27, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  70dc14fb
27 Nov, 2024 5 commits
- [Bugfix] Ignore `lm_head` when loading embedding models (#10719) · 9b4b1503
  Cyrus Leung authored Nov 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9b4b1503
- [V1] Update interface for mistral-format Pixtral (#10703) · 9e0a147d
  Roger Wang authored Nov 27, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9e0a147d
- [Model] Support telechat2 (#10311) · 1209261e
  shunxing12345 authored Nov 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  1209261e
- [Misc]Further reduce BNB static variable (#10597) · 15cc2a9f
  Jee Jee Li authored Nov 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  15cc2a9f
- [V1] Update interface for idefics3 (#10680) · 0a4d9685
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0a4d9685
26 Nov, 2024 3 commits
- [V1] Refactor model executable interface for multimodal models (#10570) · 2f0a0a17
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2f0a0a17
- [Misc] Remove outdated init protocols (#10655) · 94063534
  Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  94063534
- [bugfix] fix aria model and add torch.compile (#10645) · 45ac4ff2
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  45ac4ff2
25 Nov, 2024 6 commits
- [Model] Add OLMo November 2024 model (#10503) · 9db713a1
  Shane A authored Nov 25, 2024
  
  9db713a1
- [Model] Enable optional prefix when loading embedding models (#10639) · cf73f0c9
  Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cf73f0c9
- [Model]: Add support for Aria model (#10514) · b1d92053
  zhou fan authored Nov 26, 2024
```
Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  b1d92053
- [Model] Support `is_causal` HF config field for Qwen2 model (#10621) · ed46f143
  Cyrus Leung authored Nov 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ed46f143
- [torch.compile] support encoder based models (#10613) · 571841b7
  youkaichao authored Nov 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  571841b7
- Support Cross encoder models (#10400) · 214efc2c
  Maximilien de Bayser authored Nov 24, 2024
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  214efc2c
24 Nov, 2024 2 commits
- [model][utils] add extract_layer_index utility function (#10599) · c0557478
  youkaichao authored Nov 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c0557478
- [Bugfix] Fix LoRA weight sharding (#10450) · 1700c543
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1700c543
23 Nov, 2024 4 commits
- [Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593) · 04668ebe
  Isotr0py authored Nov 24, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  04668ebe
- [Model] Fix Baichuan BNB online quantization (#10572) · cfea9c04
  Chen Wu authored Nov 23, 2024
```
Signed-off-by: Chen Wu <cntryroa@gmail.com>
```
  cfea9c04
- [core] gemma2 full context length support (#10584) · 4aba6e3d
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4aba6e3d
- support bitsandbytes quantization with qwen model (#10549) · 948c8595
  zixuanzhang226 authored Nov 22, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  948c8595
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
21 Nov, 2024 1 commit
- [Bugfix] Allow token ID-only inputs in Qwen2-Audio (#10536) · e7a8341c
  Cyrus Leung authored Nov 22, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e7a8341c