Commits · 3920c549641d5e711a64ff2e662fa5612b24021f · OpenDAS / vllm_cscc

12 Feb, 2025 1 commit
- update mixtral.py · 3920c549
  zhuwenwen authored Feb 12, 2025
  
  3920c549
11 Feb, 2025 4 commits
- update fused_moe.py · a27fdb55
  zhuwenwen authored Feb 11, 2025
  
  a27fdb55
- Merge branch 'v0.7.2-dev' of http://10.6.10.68/dcutoolkit/deeplearing/vllm into v0.7.2-dev · 0b6a38bf
  zhuwenwen authored Feb 11, 2025
  
  0b6a38bf
- add latency · 49bfe4cb
  zhuwenwen authored Feb 11, 2025
  
  49bfe4cb
- Merge branch 'v0.7.2-dev_wm' into 'v0.7.2-dev' · 76c182d9
  zhuwenwen authored Feb 11, 2025
```
[feat]适配0.7.2版本的deepseek_v3 nn layout

See merge request dcutoolkit/deeplearing/vllm!63
```
  76c182d9
10 Feb, 2025 2 commits
- [feat]适配0.7.2版本的deepseek_v3 nn layout · 70deb5ef
  王敏 authored Feb 10, 2025
  
  70deb5ef
- update model layout · 99d49945
  zhuwenwen authored Feb 10, 2025
  
  99d49945
09 Feb, 2025 1 commit
- update llama and qwen2 layout · 92d43fd5
  zhuwenwen authored Feb 09, 2025
  
  92d43fd5
08 Feb, 2025 6 commits
- set TRITON_HIP_USE_NEW_STREAM_PIPELINE · 8f8d56c3
  zhuwenwen authored Feb 08, 2025
  
  8f8d56c3
- update layer.py · 54944679
  zhuwenwen authored Feb 08, 2025
  
  54944679
- Merge tag 'v0.7.2' into v0.7.2-dev · 66b809cc
  zhuwenwen authored Feb 08, 2025
  
  66b809cc
- [feat] add nn_moe · 37b63c24
  zhuwenwen authored Feb 08, 2025
  
  37b63c24
- add bw fused_moe_config · 2dc7ec2f
  zhuwenwen authored Feb 08, 2025
  
  2dc7ec2f
- add git config · 4333d0ef
  zhuwenwen authored Feb 08, 2025
  
  4333d0ef
06 Feb, 2025 12 commits
- update chatglm nn layout · caf953b6
  zhuwenwen authored Feb 06, 2025
  
  caf953b6
- [Misc] Improve error message for incorrect pynvml (#12809) · 0408efc6
  youkaichao authored Feb 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0408efc6
- skip arch reason · 66a7ebd8
  zhuwenwen authored Feb 06, 2025
  
  66a7ebd8
- [Misc] Remove duplicated DeepSeek V2/V3 model definition (#12793) · 449d1bce
  Michael Goin authored Feb 06, 2025
  
  449d1bce
- Improve `TransformersModel` UX (#12785) · 1a6fcad4
  Harry Mellor authored Feb 06, 2025
  
  1a6fcad4
- [Bugfix] Fix the test_ultravox.py's license (#12806) · 56534cd5
  Lu Fang authored Feb 05, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  56534cd5
- [Model] LoRA Support for Ultravox model (#11253) · d88506dd
  Sumit Vij authored Feb 05, 2025
  
  d88506dd
- [Misc][Easy] Remove the space from the file name · 9cdea30b
  Lu Fang authored Feb 05, 2025
  
  9cdea30b
- [Bugfix] Better FP8 supported defaults · 76abd0c8
  Lucas Wilkinson authored Feb 05, 2025
  
  76abd0c8
- [ROCm][Kernel] Using the correct warp_size value · 5b19b930
  Gregory Shtrasberg authored Feb 05, 2025
  
  5b19b930
- [VLM] Update compatibility with transformers 4.49 · 75404d04
  Cyrus Leung authored Feb 06, 2025
  
  75404d04
- update rocm_flash_attn.py · 49be5e62
  zhuwenwen authored Feb 06, 2025
  
  49be5e62
05 Feb, 2025 14 commits
- [VLM] Qwen2.5-VL · bf3b79ef
  Roger Wang authored Feb 05, 2025
  
  bf3b79ef
- [Docs] Drop duplicate [source] links · 9a5b1554
  Russell Bryant authored Feb 05, 2025
  
  9a5b1554
- [VLM] Use shared field to pass token ids to model · a4ce74c1
  Cyrus Leung authored Feb 06, 2025
  
  a4ce74c1
- Add: Support for Sparse24Bitmask Compressed Models · 3b2005e1
  Rahul Tuli authored Feb 05, 2025
  
  3b2005e1
- [Hardware][Intel-Gaudi] Enable FusedSDPA support for Intel Gaudi (HPU) · af8486de
  Sanju C Sudhakaran authored Feb 06, 2025
  
  af8486de
- Merging PR #12536 · 4c3aac51
  Chen Zhang authored Feb 06, 2025
```
Merged via CLI script
```
  4c3aac51
- [core][distributed] exact ray placement control (#12732) · bc1bdece
  youkaichao authored Feb 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bc1bdece
- [Bugfix] Fix 'ModuleNotFoundError: No module named... · 022bcc70
  Akash kaothalkar authored Feb 05, 2025
```
[Bugfix] Fix 'ModuleNotFoundError: No module named 'intel_extension_for_pytorch'' for --tensor-parallel-size more than 1  (#12546)
```
  022bcc70
- [Doc] Remove performance warning for auto_awq.md (#12743) · c53dc466
  Michael Goin authored Feb 05, 2025
  
  c53dc466
- [V1][Misc] Shorten `FinishReason` enum and use constant strings (#12760) · 3d09e592
  Nick Hill authored Feb 04, 2025
  
  3d09e592
- [Bugfix] Fix OpenVINO model runner (#12750) · fcf2e3d7
  Harry Mellor authored Feb 05, 2025
  
  fcf2e3d7
- [Doc] Update PR Reminder with link to Developer Slack (#12748) · 58b218d7
  Michael Goin authored Feb 05, 2025
  
  58b218d7
- [Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634) · 7ff7a638
  Kyle Sayers authored Feb 05, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  7ff7a638
- [Misc] Bump the compressed-tensors version (#12736) · 686006a2
  Dipika Sikka authored Feb 04, 2025
  
  686006a2