Commits · eee6148ae871bf5a9afa0e987b7d3f535d3c102c · OpenDAS / vllm_cscc · GitLab

13 Mar, 2025 1 commit
- update mla to obtain the optimal configuration from config · eee6148a
  zhuwenwen authored Mar 13, 2025
  
  eee6148a
12 Mar, 2025 1 commit
- [feat]添加BW deepseek_v3 fused_moe configs · abac3adc
  zhuwenwen authored Mar 12, 2025
  
  abac3adc
11 Mar, 2025 1 commit
- [feat]优化fused_moe tuning，上传K100_AI的configs · e3a0d6bb
  zhuwenwen authored Mar 11, 2025
  
  e3a0d6bb
28 Feb, 2025 1 commit
- 1. 修复w8a8找不到对应config的bug · baf7d06a
  zhuwenwen authored Feb 28, 2025
```
2. 删除vllm的w8a8 config
```
  baf7d06a
27 Feb, 2025 1 commit
- update mtp layout · c5888d31
  zhuwenwen authored Feb 27, 2025
  
  c5888d31
26 Feb, 2025 1 commit
- update deepseek-v2 · 96802ca0
  zhuwenwen authored Feb 26, 2025
  
  96802ca0
25 Feb, 2025 1 commit
- update version · 76621631
  zhuwenwen authored Feb 25, 2025
  
  76621631
22 Feb, 2025 2 commits
- update qwen2_vl nn lyaout · 437e6aef
  zhuwenwen authored Feb 22, 2025
  
  437e6aef
- support qwen2_5-vl · 0a89b8a3
  zhuwenwen authored Feb 22, 2025
  
  0a89b8a3
20 Feb, 2025 6 commits
- [Bugfix] Fix deepseekv3 grouped topk error (#13474) · ed6e9075
  chenxiaobing authored Feb 20, 2025
```
Signed-off-by: Chen-XiaoBing <chenxb002@whu.edu.cn>
```
  ed6e9075
- 适配deepseekv3\v2 moe awq的推理支持 · 47bd229c
  yangql authored Feb 20, 2025
  
  47bd229c
- [Misc] add mm_processor_kwargs to extra_body for Qwen2.5-VL (#13533) · 041e2947
  燃 authored Feb 20, 2025
  
  041e2947
- [ROCm][MoE] mi300 mixtral8x7B perf for specific BS (#13577) · 0d243f2a
  Divakar Verma authored Feb 19, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  0d243f2a
- [Misc] Qwen2.5 VL support LoRA (#13261) · 512368e3
  Jee Jee Li authored Feb 20, 2025
  
  512368e3
- [3/n][CI] Load Quantization test models with S3 (#13570) · 473f51cf
  Kevin H. Luu authored Feb 19, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  473f51cf
19 Feb, 2025 7 commits
- [VLM][Bugfix] Pass processor kwargs properly on init (#13516) · 377d10bd
  Cyrus Leung authored Feb 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  377d10bd
- [Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) · f525c0be
  Lucia Fang authored Feb 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  f525c0be
- [Bugfix] Fix Positive Feature Layers in Llava Models (#13514) · 983a40a8
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  983a40a8
- [1/n][CI] Load models in CI from S3 instead of HF (#13205) · d5d214ac
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  d5d214ac
- add deepseek-v2 tp2 fused_moe_config · 177520a9
  zhuwenwen authored Feb 19, 2025
  
  177520a9
- [ROCm][MoE configs] mi325 mixtral & mi300 qwen_moe (#13503) · 8aada19d
  Divakar Verma authored Feb 19, 2025
  
  8aada19d
- update lm_head tn layout for awq · f0e7d72d
  zhuwenwen authored Feb 19, 2025
  
  f0e7d72d
18 Feb, 2025 12 commits
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49
- add deepseek-v2 tp1 fused_moe_config · f0ac5f23
  zhuwenwen authored Feb 18, 2025
  
  f0ac5f23
- [Bugfix] Fix failing transformers dynamic module resolving with spawn multiproc method (#13403) · 8cf97f86
  Isotr0py authored Feb 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8cf97f86
- 增加lm_nn的量化控控控制,控制为tn · 41d0696e
  gaoqiong authored Feb 18, 2025
  
  41d0696e
- Add outlines fallback when JSON schema has enum (#13449) · b53d7998
  Michael Goin authored Feb 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b53d7998
- 添加w8a8 关于0.7.2的修改 · 8c61b2ed
  gaoqiong authored Feb 18, 2025
  
  8c61b2ed
- [Quant] Aria SupportsQuant (#13416) · d1b649f1
  Kyle Sayers authored Feb 18, 2025
  
  d1b649f1
- [Quant] Arctic SupportsQuant (#13366) · 00294e1b
  Kyle Sayers authored Feb 18, 2025
  
  00294e1b
- [Quant] Molmo SupportsQuant (#13336) · 88787bce
  Kyle Sayers authored Feb 18, 2025
  
  88787bce
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
- [Misc] Remove dangling references to `SamplingType.BEAM` (#13402) · efbe8544
  Harry Mellor authored Feb 18, 2025
  
  efbe8544
- [Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425) · b3942e15
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  b3942e15
17 Feb, 2025 4 commits
- [fix]1.解决deepseekv2/v3 nn layout加载报错问题;2.上传ep1和ep2的fused_moe config · 249fca2a
  王敏 authored Feb 17, 2025
  
  249fca2a
- [Model] Support Mamba2 (Codestral Mamba) (#9292) · 1f69c4a8
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  1f69c4a8
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
- [Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304) · 46cdd595
  shangmingc authored Feb 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  46cdd595
16 Feb, 2025 1 commit
- [Quant] Add `SupportsQuant` to phi3 and clip (#13104) · 12913d17
  Kyle Sayers authored Feb 15, 2025
  
  12913d17
15 Feb, 2025 1 commit
- [Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331) · 367cb8ce
  Cyrus Leung authored Feb 15, 2025
  
  367cb8ce