Commits · 55c5f16ffbe4c8149d6bbd89a0966097ec6e7da6 · OpenDAS / vllm_cscc

07 Nov, 2024 2 commits
- remove xformers deps · 55c5f16f
  zhuwenwen authored Nov 07, 2024
  
  55c5f16f
- 1.Mixtral模型的gemm由TN改为NN · e7d022fd
  王敏 authored Nov 07, 2024
  
  e7d022fd
06 Nov, 2024 2 commits
- optimize qwen2-moe layout · 82aee745
  zhuwenwen authored Nov 06, 2024
  
  82aee745
- 1.解决medusa模型多卡推理结果异常问题 · f9060e6b
  王敏 authored Nov 06, 2024
```
2.examples中添加medusa readme
3.修复model_runner中input_positions配置错误的笔误，解决多个模型运行失败问题
```
  f9060e6b
04 Nov, 2024 1 commit
- optimize qwen2-vl layout · a4167889
  zhuwenwen authored Nov 04, 2024
  
  a4167889
30 Oct, 2024 2 commits
- remove unused code · 04d33670
  zhuwenwen authored Oct 30, 2024
  
  04d33670
- auto convert lm_head layout of llama · 1428c17d
  zhuwenwen authored Oct 30, 2024
  
  1428c17d
29 Oct, 2024 3 commits
- update llama.py · 85def94c
  zhuwenwen authored Oct 29, 2024
  
  85def94c
- [Model] Add telechat-12b and GLM-4v support · 1e4ba896
  zhuwenwen authored Oct 29, 2024
  
  1e4ba896
- [Model] Add GLM-4v support · cbdc3a13
  zhuwenwen authored Oct 29, 2024
  
  cbdc3a13
28 Oct, 2024 1 commit
- update lm_head of llama · 112588c2
  zhuwenwen authored Oct 28, 2024
  
  112588c2
25 Oct, 2024 1 commit
- support telechat-12b · fa5b0b39
  zhuwenwen authored Oct 25, 2024
  
  fa5b0b39
24 Oct, 2024 1 commit
- 增加medusa并行解码功能,后续增加使用说明和测试文档 · 19bc93d9
  王敏 authored Oct 24, 2024
  
  19bc93d9
23 Oct, 2024 1 commit
- update llama.py · 905411f1
  zhuwenwen authored Oct 23, 2024
  
  905411f1
16 Oct, 2024 1 commit
- update paged_attn.py · 85e8224c
  zhuwenwen authored Oct 16, 2024
  
  85e8224c
15 Oct, 2024 1 commit
- support baichuan awq and skip _rocm_C · b3ab1cdc
  zhuwenwen authored Oct 15, 2024
  
  b3ab1cdc
11 Oct, 2024 2 commits
- [Model] support telechat_12B · 6d4b207a
  zhuwenwen authored Oct 11, 2024
  
  6d4b207a
- [Misc] Update config loading for Qwen2-VL and remove Granite · a7e72c36
  zhuwenwen authored Oct 11, 2024
  
  a7e72c36
09 Oct, 2024 2 commits
- 增加AWQ相关环境变量控制 · cc4b902f
  zhuwenwen authored Oct 09, 2024
  
  cc4b902f
- 添加w8a8 rocblas非融合支持 · 35a8304d
  zhuwenwen authored Oct 09, 2024
  
  35a8304d
25 Sep, 2024 8 commits
- [Misc] Support quantization of MllamaForCausalLM (#8822) · 7193774b
  Michael Goin authored Sep 25, 2024
  
  7193774b
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602
- [Misc] Support FP8 MoE for compressed-tensors (#8588) · 873edda6
  Michael Goin authored Sep 25, 2024
  
  873edda6
- [VLM][Bugfix] internvl with num_scheduler_steps > 1 (#8614) · 0c4d2ad5
  DefTruth authored Sep 26, 2024
  
  0c4d2ad5
- [Bugfix] load fc bias from config for eagle (#8790) · 3e073e66
  sohamparikh authored Sep 25, 2024
  
  3e073e66
- [Hardware][CPU] Enable mrope and support Qwen2-VL on CPU backend (#8770) · c2395367
  Isotr0py authored Sep 25, 2024
  
  c2395367
- [BugFix] Propagate 'trust_remote_code' setting in internvl and minicpmv (#8250) · e3dd0692
  zifeitong authored Sep 24, 2024
  
  e3dd0692
- remove reason of unsupported · a087cda8
  zhuwenwen authored Sep 25, 2024
  
  a087cda8
24 Sep, 2024 2 commits
- [Model] Expose Phi3v num_crops as a mm_processor_kwarg (#8658) · 8ff7ced9
  Alex Brooks authored Sep 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ff7ced9
- [Core][Model] Support loading weights by ID within models (#7931) · 3f06bae9
  Peter Salas authored Sep 24, 2024
  
  3f06bae9
23 Sep, 2024 2 commits
- [VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use... · f2bd246c
  Jani Monoses authored Sep 23, 2024
```
[VLM] Fix paligemma, fuyu and persimmon with transformers 4.45 : use config.text_config.vocab_size (#8707)
```
  f2bd246c
- [Model] Support pp for qwen2-vl (#8696) · a79e5229
  Yanyi Liu authored Sep 23, 2024
  
  a79e5229
22 Sep, 2024 3 commits
- [Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327
  litianjian authored Sep 23, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5b595327
- [Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
  Cyrus Leung authored Sep 22, 2024
  
  06ed2815
- [Bugfix] Refactor composite weight loading logic (#8656) · 13d88d41
  Isotr0py authored Sep 22, 2024
  
  13d88d41
21 Sep, 2024 2 commits
- [dbrx] refactor dbrx experts to extend FusedMoe class (#8518) · 9dc7c6c7
  Divakar Verma authored Sep 21, 2024
  
  9dc7c6c7
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
20 Sep, 2024 3 commits
- [Bugfix] Fix incorrect llava next feature size calculation (#8496) · 0f961b3c
  zyddnys authored Sep 20, 2024
  
  0f961b3c
- [Model] Add OLMoE (#7922) · 3b63de93
  Niklas Muennighoff authored Sep 20, 2024
  
  3b63de93
- [Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571) · 18ae428a
  Amit Garg authored Sep 19, 2024
  
  18ae428a