Commits · b1d920531f6d5fd6c020096499c91a8f26620cd6 · OpenDAS / vllm_cscc

"tests/fault_tolerance/vscode:/vscode.git/clone" did not exist on "0fa9b9983d14c07831872ddc0615903e8ed328c7"

25 Nov, 2024 4 commits

[Model]: Add support for Aria model (#10514) · b1d92053

zhou fan authored Nov 26, 2024


Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

b1d92053

[Model] Support `is_causal` HF config field for Qwen2 model (#10621) · ed46f143
Cyrus Leung authored Nov 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ed46f143
[torch.compile] support encoder based models (#10613) · 571841b7
youkaichao authored Nov 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
571841b7

Support Cross encoder models (#10400) · 214efc2c

Maximilien de Bayser authored Nov 24, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

214efc2c

24 Nov, 2024 2 commits
- [model][utils] add extract_layer_index utility function (#10599) · c0557478
  youkaichao authored Nov 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c0557478
- [Bugfix] Fix LoRA weight sharding (#10450) · 1700c543
  Jee Jee Li authored Nov 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1700c543
23 Nov, 2024 4 commits
- [Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593) · 04668ebe
  Isotr0py authored Nov 24, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  04668ebe
- [Model] Fix Baichuan BNB online quantization (#10572) · cfea9c04
  Chen Wu authored Nov 23, 2024
```
Signed-off-by: Chen Wu <cntryroa@gmail.com>
```
  cfea9c04
- [core] gemma2 full context length support (#10584) · 4aba6e3d
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4aba6e3d
- support bitsandbytes quantization with qwen model (#10549) · 948c8595
  zixuanzhang226 authored Nov 22, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  948c8595
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
21 Nov, 2024 4 commits
- [Bugfix] Allow token ID-only inputs in Qwen2-Audio (#10536) · e7a8341c
  Cyrus Leung authored Nov 22, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e7a8341c
- [Model] Expose `dynamic_image_size` as mm_processor_kwargs for InternVL2 models (#10518) · d5ec121f
  Isotr0py authored Nov 21, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d5ec121f
- [Model] Add Support for Multimodal Granite Models (#10291) · 1cfde82f
  Alex Brooks authored Nov 21, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1cfde82f
- [torch.compile] limit inductor threads and lazy import quant (#10482) · 388ee3de
  youkaichao authored Nov 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  388ee3de
20 Nov, 2024 2 commits
- [model] Reduce medusa weight (#10454) · 343041c4
  Sky Lee authored Nov 20, 2024
```
Signed-off-by: skylee-01 <497627264@qq.com>
```
  343041c4
- [Bugfix] Fix Mamba model initialization and MLP Speculator weights loading (#10456) · ad44437b
  Isotr0py authored Nov 20, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ad44437b
19 Nov, 2024 4 commits
- [Pixtral-Large] Pixtral actually has no bias in vision-lang adapter (#10449) · 11fd7ea6
  Patrick von Platen authored Nov 19, 2024
  
  11fd7ea6
- [Misc] Avoid misleading warning messages (#10438) · 382b6a48
  Jee Jee Li authored Nov 19, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  382b6a48
- [Platform][Refactor] Extract func `get_default_attn_backend` to `Platform` (#10358) · 8c1fb507
  Mengqing Cao authored Nov 19, 2024
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  8c1fb507
- [Bugfix]Fix Phi-3 BNB online quantization (#10417) · 7eb719df
  Jee Jee Li authored Nov 19, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7eb719df
18 Nov, 2024 6 commits
- [Model][Bugfix] Support TP for PixtralHF ViT (#10405) · 281cc4b3
  Michael Goin authored Nov 18, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  281cc4b3
- [5/N][torch.compile] torch.jit.script --> torch.compile (#10406) · 7851b451
  youkaichao authored Nov 18, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7851b451
- [Model] Remove transformers attention porting in VITs (#10414) · e7ebb662
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e7ebb662
- [Model][LoRA]LoRA support added for glm-4v (#10418) · 5be4e52b
  B-201 authored Nov 18, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  5be4e52b
- [VLM] Report multi_modal_placeholders in output (#10407) · c7dec926
  lkchen authored Nov 18, 2024
```
Signed-off-by: Linkun Chen <lkchen+anyscale@github.com>
```
  c7dec926
- [Misc] Add uninitialized params tracking for `AutoWeightsLoader` (#10327) · c4e46433
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c4e46433
17 Nov, 2024 1 commit
- [V1] Refactor model executable interface for all text-only language models (#10374) · 643ecf7b
  Roger Wang authored Nov 16, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  643ecf7b
16 Nov, 2024 1 commit
- [Misc] Medusa supports custom bias (#10361) · b98d89ef
  Sky Lee authored Nov 17, 2024
  
  b98d89ef
15 Nov, 2024 4 commits
- Add default value to avoid Falcon crash (#5363) (#10347) · 3d158cdc
  wchen61 authored Nov 15, 2024
```
Signed-off-by: wchen61 <wchen61@foxmail.com>
```
  3d158cdc
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
- [Perf] Reduce peak memory usage of llama (#10339) · b2e0ad3b
  Murali Andoorveedu authored Nov 14, 2024
```
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
```
  b2e0ad3b
14 Nov, 2024 4 commits
- Support Roberta embedding models (#9387) · 4a18fd14
  Maximilien de Bayser authored Nov 14, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  4a18fd14
- [Model] Add BNB quantization support for Idefics3 (#10310) · 294bf467
  B-201 authored Nov 14, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294bf467
- [misc] error early for old-style class (#10304) · 504ac53d
  youkaichao authored Nov 13, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  504ac53d
- [Bugfix] Fix tensor parallel for qwen2 classification model (#10297) · 15bb8330
  Isotr0py authored Nov 14, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  15bb8330
13 Nov, 2024 3 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [Model][LoRA]LoRA support added for idefics3 (#10281) · d909acf9
  B-201 authored Nov 13, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  d909acf9
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1