Commits · ffa48c9146fda1e8810d1cfa159e1d70aadae6c6 · OpenDAS / vllm_cscc · GitLab

11 Dec, 2024 1 commit
- [Model] PP support for Mamba-like models (#10992) · ffa48c91
  Mor Zusman authored Dec 11, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  ffa48c91
10 Dec, 2024 5 commits
- [Core] Update to outlines >= 0.1.8 (#10576) · e7391949
  Russell Bryant authored Dec 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e7391949
- [Bugfix] Fix xgrammar failing to read a vocab_size from LlavaConfig on PixtralHF. (#11043) · e35879c2
  Jeff Cook authored Dec 09, 2024
  
  e35879c2
- [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) · 28b3a1c7
  Tyler Michael Smith authored Dec 10, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  28b3a1c7
- [Pixtral] Improve loading (#11040) · bc192a2b
  Patrick von Platen authored Dec 10, 2024
  
  bc192a2b
- [Model] Add has_weight to RMSNorm and re-enable weights loading tracker for Mamba (#10739) · d1f6d1c8
  Isotr0py authored Dec 10, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d1f6d1c8
09 Dec, 2024 1 commit
- [Model] merged input processor for Phi-3-Vision models (#10977) · a811dd66
  Isotr0py authored Dec 10, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a811dd66
08 Dec, 2024 1 commit
- [V1] Initial support of multimodal models for V1 re-arch (#10699) · a11f3265
  Roger Wang authored Dec 08, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  a11f3265
07 Dec, 2024 4 commits
- [Doc] Explicitly state that PP isn't compatible with speculative decoding yet (#10975) · c889d588
  Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c889d588
- [Model] Update multi-modal processor to support Mantis(LLaVA) model (#10711) · 39e227c7
  Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39e227c7
- [Model] Composite weight loading for multimodal Qwen2 (#10944) · bf0e382e
  Cyrus Leung authored Dec 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf0e382e
- [3/N] Support and implement merged input processor for LLaVA model (#10676) · 955fa953
  Cyrus Leung authored Dec 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  955fa953
06 Dec, 2024 1 commit
- [Core] Support Lark grammars for XGrammar (#10870) · 8b596318
  Michael Goin authored Dec 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8b596318
05 Dec, 2024 2 commits
- [Bugfix] Fix BNB loader target_modules (#10720) · 1f958a7d
  Jee Jee Li authored Dec 05, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1f958a7d
- [Bugfix] Fallback to outlines for complex json schemas (#10899) · 8d370e91
  Michael Goin authored Dec 04, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8d370e91
04 Dec, 2024 1 commit
- [Model] Consolidate ViTs attention implementation without mask (#10893) · 10398b47
  Isotr0py authored Dec 05, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  10398b47
03 Dec, 2024 5 commits
- [Bugfix] Only require XGrammar on x86 (#10865) · 7090c27b
  Michael Goin authored Dec 03, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  7090c27b
- [Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315
  Aaron Pham authored Dec 03, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  9323a315
- [Misc] Remove deprecated names (#10817) · 3257d449
  Cyrus Leung authored Dec 03, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3257d449
- [torch.compile] remove compilation_context and simplify code (#10838) · dc5ce861
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dc5ce861
- [Model] support bitsandbytes quantization with minicpm model (#10842) · d746268e
  zixuanzhang226 authored Dec 02, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  d746268e
02 Dec, 2024 3 commits
- [Model] Add TP and BNB quantization support to LlavaMultiModalProjector (#10834) · 4c05edb3
  Isotr0py authored Dec 03, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4c05edb3
- [misc] remove xverse modeling file (#10814) · 63a16417
  youkaichao authored Dec 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  63a16417
- [Model] Add BNB support to Llava and Pixtral-HF (#10795) · b18c9bba
  Isotr0py authored Dec 02, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b18c9bba
01 Dec, 2024 2 commits
- [Misc] Rename embedding classes to pooling (#10801) · d2f058e7
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f058e7
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
30 Nov, 2024 2 commits
- [Interleaved ATTN] Support for Mistral-8B (#10591) · e7cfc4ef
  Patrick von Platen authored Nov 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  e7cfc4ef
- [Model] Refactor Molmo weights loading to use AutoWeightsLoader (#10771) · 16ee07f2
  Isotr0py authored Nov 30, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  16ee07f2
29 Nov, 2024 3 commits
- [Bugfix] Fix Idefics3 bug (#10778) · 3132aac0
  Jee Jee Li authored Nov 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3132aac0
- [Misc] typo find in sampling_metadata.py (#10740) · c82b432d
  wang.yuqi authored Nov 29, 2024
  
  c82b432d
- [Model] Clean up MiniCPMV (#10751) · fa6ecb9a
  Cyrus Leung authored Nov 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fa6ecb9a
28 Nov, 2024 3 commits
- [Model] Add Internlm2 LoRA support (#5064) · c83919c7
  Isotr0py authored Nov 29, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c83919c7
- [Model] Added GLM-4 series hf format model support vllm==0.6.4 (#10561) · 5fc5ce0f
  sixgod authored Nov 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5fc5ce0f
- [Model] support bitsandbytes quantization with minicpm3 model (#10682) · 70dc14fb
  zixuanzhang226 authored Nov 27, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  70dc14fb
27 Nov, 2024 6 commits
- [Bugfix] Ignore `lm_head` when loading embedding models (#10719) · 9b4b1503
  Cyrus Leung authored Nov 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9b4b1503
- [Bugfix] Fix GGUF inference with FP16 unquantized checkpoint (#10675) · b98c62ba
  Isotr0py authored Nov 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b98c62ba
- [V1] Update interface for mistral-format Pixtral (#10703) · 9e0a147d
  Roger Wang authored Nov 27, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9e0a147d
- [Model] Support telechat2 (#10311) · 1209261e
  shunxing12345 authored Nov 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  1209261e
- [Misc]Further reduce BNB static variable (#10597) · 15cc2a9f
  Jee Jee Li authored Nov 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  15cc2a9f
- [bugfix] fix the default value of llm_int8_threshold in BitsAndBytesConfig (#10657) · cfb3bf25
  yansh97 authored Nov 27, 2024
  
  cfb3bf25