Commits · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc · GitLab

03 Dec, 2024 2 commits
- 增加w8a8的triton调度支持 · 1a9775b8
  gaoqiong authored Dec 03, 2024
  
  1a9775b8
- 增加w8a8的triton调度支持 · 1c77f16e
  gaoqiong authored Dec 03, 2024
  
  1c77f16e
27 Nov, 2024 1 commit
- [Misc]Further reduce BNB static variable (#10597) · 15cc2a9f
  Jee Jee Li authored Nov 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  15cc2a9f
23 Nov, 2024 1 commit
- support bitsandbytes quantization with qwen model (#10549) · 948c8595
  zixuanzhang226 authored Nov 22, 2024
```
Signed-off-by: Ubuntu <zixuanzhang@bytedance.com>
```
  948c8595
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
19 Nov, 2024 1 commit
- [Misc] Avoid misleading warning messages (#10438) · 382b6a48
  Jee Jee Li authored Nov 19, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  382b6a48
18 Nov, 2024 1 commit
- [Misc] Add uninitialized params tracking for `AutoWeightsLoader` (#10327) · c4e46433
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c4e46433
17 Nov, 2024 1 commit
- [V1] Refactor model executable interface for all text-only language models (#10374) · 643ecf7b
  Roger Wang authored Nov 16, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  643ecf7b
13 Nov, 2024 1 commit
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
12 Nov, 2024 1 commit
- [Bugfix] Fix QwenModel argument (#10262) · 176fcb1c
  Jie Fu (傅杰) authored Nov 13, 2024
```
Signed-off-by: Jie Fu <jiefu@tencent.com>
```
  176fcb1c
11 Nov, 2024 1 commit
- [6/N] pass whole config to inner model (#10205) · f89d18ff
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f89d18ff
09 Nov, 2024 2 commits
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
- [0/N] Rename `MultiModalInputs` to `MultiModalKwargs` (#10040) · e0191a95
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e0191a95
06 Nov, 2024 3 commits
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
- Remove ScaledActivation for AWQ (#10057) · 399c7986
  Michael Goin authored Nov 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  399c7986
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
01 Nov, 2024 2 commits
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
31 Oct, 2024 1 commit
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
29 Oct, 2024 1 commit
- [Model][LoRA]LoRA support added for Qwen (#9622) · 7a4df5f2
  Jee Jee Li authored Oct 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7a4df5f2
16 Oct, 2024 1 commit
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
09 Oct, 2024 2 commits
- 增加AWQ相关环境变量控制 · cc4b902f
  zhuwenwen authored Oct 09, 2024
  
  cc4b902f
- 添加w8a8 rocblas非融合支持 · 35a8304d
  zhuwenwen authored Oct 09, 2024
  
  35a8304d
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

25 Sep, 2024 1 commit
- [BugFix] Propagate 'trust_remote_code' setting in internvl and minicpmv (#8250) · e3dd0692
  zifeitong authored Sep 24, 2024
  
  e3dd0692
21 Sep, 2024 1 commit
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
12 Sep, 2024 1 commit

[Model] Support multiple images for qwen-vl (#8247) · c6202dae

Alex Brooks authored Sep 12, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c6202dae

05 Sep, 2024 1 commit
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
30 Aug, 2024 1 commit
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
20 Aug, 2024 1 commit
- [Bugfix] support `tie_word_embeddings` for all models (#5724) · f4fc7337
  Zijian Hu authored Aug 19, 2024
  
  f4fc7337
19 Aug, 2024 1 commit
- Add fa pad conditions and automatic switching strategy · b40f2ffc
  zhuwenwen authored Aug 19, 2024
  
  b40f2ffc
17 Aug, 2024 1 commit
- update fp16 model layout conversion conditions · 4d821524
  zhuwenwen authored Aug 17, 2024
  
  4d821524
13 Aug, 2024 1 commit
- [Bugfix] Fix weight loading for Chameleon when TP>1 (#7410) · 7025b11d
  Cyrus Leung authored Aug 13, 2024
  
  7025b11d
09 Aug, 2024 1 commit
- 增添lmslim gptq支持 · dcaabcf7
  gaoqiong authored Aug 09, 2024
  
  dcaabcf7
08 Aug, 2024 1 commit
- fix awq index of qwen · 04633c47
  zhuwenwen authored Aug 08, 2024
  
  04633c47
04 Aug, 2024 1 commit
- add qwen awq support · 982c1545
  gaoqiong authored Aug 05, 2024
  
  982c1545
01 Aug, 2024 2 commits
- [Models] Support Qwen model with PP (#6974) · fc912e08
  Murali Andoorveedu authored Aug 01, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  fc912e08
- support fa pad · ffbef65c
  zhuwenwen authored Aug 01, 2024
  
  ffbef65c
24 Jul, 2024 2 commits
- support transpose lm_head weight to nn layout · 99426767
  zhuwenwen authored Jul 24, 2024
  
  99426767
- add gemm pad and fa pad for 7b model · 0b5e4e11
  zhuwenwen authored Jul 24, 2024
  
  0b5e4e11