Commits · 0590ec3fd9857063c43c80df281e24c16c51b2ec · OpenDAS / vllm_cscc

"fern/pages/router/README.md" did not exist on "129a2444e04fd836a2bcd79bb46192a765ccabb0"

01 Dec, 2024 2 commits
- [Misc] Rename embedding classes to pooling (#10801) · d2f058e7
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f058e7
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
30 Nov, 2024 2 commits
- [Interleaved ATTN] Support for Mistral-8B (#10591) · e7cfc4ef
  Patrick von Platen authored Nov 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  e7cfc4ef
- [Model] Refactor Molmo weights loading to use AutoWeightsLoader (#10771) · 16ee07f2
  Isotr0py authored Nov 30, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  16ee07f2
29 Nov, 2024 3 commits
- [Bugfix] Fix Idefics3 bug (#10778) · 3132aac0
  Jee Jee Li authored Nov 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3132aac0
- [Misc] typo find in sampling_metadata.py (#10740) · c82b432d
  wang.yuqi authored Nov 29, 2024
  
  c82b432d
- [Model] Clean up MiniCPMV (#10751) · fa6ecb9a
  Cyrus Leung authored Nov 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fa6ecb9a
28 Nov, 2024 3 commits
- [Model] Add Internlm2 LoRA support (#5064) · c83919c7
  Isotr0py authored Nov 29, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c83919c7
- [Model] Added GLM-4 series hf format model support vllm==0.6.4 (#10561) · 5fc5ce0f
  sixgod authored Nov 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5fc5ce0f
- [Model] support bitsandbytes quantization with minicpm3 model (#10682) · 70dc14fb
  zixuanzhang226 authored Nov 27, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  70dc14fb
27 Nov, 2024 8 commits
- [Bugfix] Ignore `lm_head` when loading embedding models (#10719) · 9b4b1503
  Cyrus Leung authored Nov 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9b4b1503
- [Bugfix] Fix GGUF inference with FP16 unquantized checkpoint (#10675) · b98c62ba
  Isotr0py authored Nov 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b98c62ba
- [V1] Update interface for mistral-format Pixtral (#10703) · 9e0a147d
  Roger Wang authored Nov 27, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9e0a147d
- [Model] Support telechat2 (#10311) · 1209261e
  shunxing12345 authored Nov 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  1209261e
- [Misc]Further reduce BNB static variable (#10597) · 15cc2a9f
  Jee Jee Li authored Nov 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  15cc2a9f
- [bugfix] fix the default value of llm_int8_threshold in BitsAndBytesConfig (#10657) · cfb3bf25
  yansh97 authored Nov 27, 2024
  
  cfb3bf25
- [V1] Update interface for idefics3 (#10680) · 0a4d9685
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0a4d9685
- Remove hard-dependencies of Speculative decode to CUDA workers (#10587) · 0a71900b
  Chendi.Xue authored Nov 26, 2024
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  0a71900b
26 Nov, 2024 4 commits
- [V1] Refactor model executable interface for multimodal models (#10570) · 2f0a0a17
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2f0a0a17
- [Bugfix] Check bnb_4bit_quant_storage for bitsandbytes (#10642) · 7576cd38
  Michael Goin authored Nov 26, 2024
  
  7576cd38
- [Misc] Remove outdated init protocols (#10655) · 94063534
  Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  94063534
- [bugfix] fix aria model and add torch.compile (#10645) · 45ac4ff2
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  45ac4ff2
25 Nov, 2024 7 commits
- [Model] Add OLMo November 2024 model (#10503) · 9db713a1
  Shane A authored Nov 25, 2024
  
  9db713a1
- [Model] Enable optional prefix when loading embedding models (#10639) · cf73f0c9
  Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cf73f0c9
- [Model]: Add support for Aria model (#10514) · b1d92053
  zhou fan authored Nov 26, 2024
```
Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  b1d92053
- [Model] Support `is_causal` HF config field for Qwen2 model (#10621) · ed46f143
  Cyrus Leung authored Nov 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ed46f143
- [misc] move functions to config.py (#10624) · 05d1f8c9
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  05d1f8c9
- [torch.compile] support encoder based models (#10613) · 571841b7
  youkaichao authored Nov 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  571841b7
- Support Cross encoder models (#10400) · 214efc2c
  Maximilien de Bayser authored Nov 24, 2024
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  214efc2c
24 Nov, 2024 3 commits
- [model][utils] add extract_layer_index utility function (#10599) · c0557478
  youkaichao authored Nov 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c0557478
- [Bugfix] Fix LoRA weight sharding (#10450) · 1700c543
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1700c543
- [bugfix] Fix example/tensorize_vllm_model tests (#10595) · 17d8fc18
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  17d8fc18
23 Nov, 2024 4 commits
- [Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593) · 04668ebe
  Isotr0py authored Nov 24, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  04668ebe
- [Model] Fix Baichuan BNB online quantization (#10572) · cfea9c04
  Chen Wu authored Nov 23, 2024
```
Signed-off-by: Chen Wu <cntryroa@gmail.com>
```
  cfea9c04
- [core] gemma2 full context length support (#10584) · 4aba6e3d
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4aba6e3d
- support bitsandbytes quantization with qwen model (#10549) · 948c8595
  zixuanzhang226 authored Nov 22, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  948c8595
22 Nov, 2024 2 commits
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
- [Bugfix] Fix Phi-3 BNB quantization with tensor parallel (#9948) · b6374e09
  Isotr0py authored Nov 22, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b6374e09
21 Nov, 2024 2 commits
- [Bugfix] Allow token ID-only inputs in Qwen2-Audio (#10536) · e7a8341c
  Cyrus Leung authored Nov 22, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e7a8341c
- [Bugfix] Embedding model pooling_type equals ALL and multi input's bug (#10494) · 4d676f08
  Xiaoyu Zhang authored Nov 21, 2024
  
  4d676f08