Commits · 220e6456ff4f1bfb897154e32549f28b5e597c97 · OpenDAS / vllm_cscc

06 Jan, 2025 1 commit
- update qwen2-moe layout and benchmark_throughput.py · 220e6456
  zhuwenwen authored Jan 06, 2025
  
  220e6456
04 Jan, 2025 1 commit
- update qwen&qwen2-moe and baichuan layout · f9f4a735
  zhuwenwen authored Jan 04, 2025
  
  f9f4a735
03 Jan, 2025 3 commits
- remove gemm and fa pad · ca7f98e5
  zhuwenwen authored Jan 03, 2025
  
  ca7f98e5
- update qwen2 and mixtral layout · 57adffa2
  zhuwenwen authored Jan 03, 2025
  
  57adffa2
- fix run error · 184b50f7
  zhuwenwen authored Jan 03, 2025
  
  184b50f7
27 Dec, 2024 1 commit

Simon Mo authored Dec 26, 2024


Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: robertgshaw2-neuralmagic <rshaw@neuralmagic.com>

f49777ba

26 Dec, 2024 1 commit
- [Model] Modify MolmoForCausalLM MLP (#11510) · f57ee565
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f57ee565
25 Dec, 2024 2 commits
- [Model] Update Qwen2-Audio model support · df81235f
  zhuwenwen authored Dec 25, 2024
  
  df81235f
- [Model] Add Qwen2-Audio model support · 3c23ce2d
  zhuwenwen authored Dec 25, 2024
  
  3c23ce2d
24 Dec, 2024 3 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Misc] Move weights mapper (#11443) · 196c34b0
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  196c34b0
- [Bugfix] Fix Qwen2-VL LoRA weight loading (#11430) · b1b1038f
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b1b1038f
23 Dec, 2024 2 commits
- [Bugfix] Add kv cache scales to gemma2.py (#11269) · 60fb4f3b
  Michael Goin authored Dec 23, 2024
  
  60fb4f3b
- 1.解决qwen lora模型推理结果异常问题 · da39222e
  王敏 authored Dec 23, 2024
```
2.修复medusa推理时内存访问越界问题
3.benchmark_moe添加deepseek_v2模型
```
  da39222e
21 Dec, 2024 1 commit
- [Bugfix] Fix issues for `Pixtral-Large-Instruct-2411` (#11393) · c2d1b075
  Roger Wang authored Dec 21, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
  c2d1b075
19 Dec, 2024 6 commits

[Model] Refactor Qwen2-VL to use merged multimodal processor (#11258) · e24113a8

Isotr0py authored Dec 20, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

e24113a8

[V1] Fix multimodal profiling for `Molmo` (#11325) · 7379b3d4
Roger Wang authored Dec 19, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
7379b3d4

[Model] Add JambaForSequenceClassification model (#10860) · 6c7f8815

Yehoshua Cohen authored Dec 19, 2024


Signed-off-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

6c7f8815

[Bugfix] Cleanup Pixtral HF code (#11333) · a0f7d53b
Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a0f7d53b
增加w8a8 triton warmup代码 · 7ef78993
gaoqiong authored Dec 19, 2024

7ef78993
[VLM] Merged multimodal processor for Qwen2-Audio (#11303) · 6142ef0a
Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6142ef0a

18 Dec, 2024 1 commit
- [Bugfix] Fix broken phi3-v mm_processor_kwargs tests (#11263) · 996aa70f
  Isotr0py authored Dec 19, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  996aa70f
17 Dec, 2024 1 commit
- [V1][VLM] Proper memory profiling for image language models (#11210) · 59c9b6eb
  Roger Wang authored Dec 16, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: ywang96 <ywang@example.com>
```
  59c9b6eb
16 Dec, 2024 2 commits
- [Model] Refactor Ultravox to use merged input processor (#11198) · d927dbcd
  Isotr0py authored Dec 16, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d927dbcd
- [Model] Support Cohere2ForCausalLM (Cohere R7B) (#11203) · bddbbcb1
  Jani Monoses authored Dec 16, 2024
  
  bddbbcb1
15 Dec, 2024 1 commit
- [Bugfix] Fix error handling of unsupported sliding window (#11213) · 96d673e0
  Cyrus Leung authored Dec 16, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96d673e0
14 Dec, 2024 1 commit
- [VLM] Fully dynamic prompt replacement in merged input processor (#11199) · 93abf23a
  Cyrus Leung authored Dec 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93abf23a
13 Dec, 2024 6 commits
- [V1][VLM] Fix edge case bug for InternVL2 (#11165) · 969da7d7
  Roger Wang authored Dec 13, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  969da7d7
- [Frontend] Separate pooling APIs in offline inference (#11129) · eeec9e33
  Cyrus Leung authored Dec 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eeec9e33
- PaliGemma 2 support (#11142) · 7cd74091
  Jani Monoses authored Dec 13, 2024
  
  7cd74091
- [core] clean up cudagraph batchsize padding logic (#10996) · be39e3cd
  youkaichao authored Dec 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  be39e3cd
- [Bugfix] Update starcoder2 to remap k/v scale names for kv_cache quantization (#11148) · 3989a798
  Dipika Sikka authored Dec 13, 2024
  
  3989a798
- [Bugfix] Use runner_type instead of task in GritLM (#11144) · 1efce686
  Pooya Davoodi authored Dec 12, 2024
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  1efce686
12 Dec, 2024 2 commits
- [Bugfix] Quick fix to make Pixtral-HF load correctly again after 39e227c7 . (#11024) · 5d712571
  Jeff Cook authored Dec 12, 2024
  
  5d712571
- [Model] Add support for embedding model GritLM (#10816) · 1da8f0e1
  Pooya Davoodi authored Dec 11, 2024
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  1da8f0e1
11 Dec, 2024 2 commits
- [Bugfix] Fix Idefics3 fails during multi-image inference (#11080) · 2e32f5d2
  B-201 authored Dec 11, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  2e32f5d2
- [Model] PP support for Mamba-like models (#10992) · ffa48c91
  Mor Zusman authored Dec 11, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  ffa48c91
10 Dec, 2024 2 commits
- [Pixtral] Improve loading (#11040) · bc192a2b
  Patrick von Platen authored Dec 10, 2024
  
  bc192a2b
- [Model] Add has_weight to RMSNorm and re-enable weights loading tracker for Mamba (#10739) · d1f6d1c8
  Isotr0py authored Dec 10, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d1f6d1c8
09 Dec, 2024 1 commit
- [Model] merged input processor for Phi-3-Vision models (#10977) · a811dd66
  Isotr0py authored Dec 10, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a811dd66