Commits · dab3026ce0708f993afd75e4f692f8754637527b · OpenDAS / vllm_cscc

"tests/serve/test_prometheus_exposition_format_injection.py" did not exist on "6fe2152bfca7bb1fa681eae957b252c6cd0b7a53"

20 Nov, 2024 4 commits
- Merge branch 'v0.6.2-dev_wm' into 'v0.6.2-dev' · dab3026c
  zhuwenwen authored Nov 20, 2024
```
[fix]修复单测test_encoder_decoder_model_runner报 list index out of range错误

See merge request dcutoolkit/deeplearing/vllm!37
```
  dab3026c
- Merge remote-tracking branch 'origin/v0.6.2-dev' into v0.6.2-dev · a2217966
  王敏 authored Nov 20, 2024
  
  a2217966
- [fix]修复单测test_encoder_decoder_model_runner报错问题 · 93089fb2
  王敏 authored Nov 20, 2024
  
  93089fb2
- remove xops · 1a493a24
  zhuwenwen authored Nov 20, 2024
  
  1a493a24
19 Nov, 2024 7 commits
- update fa interface tests · fc7db442
  zhuwenwen authored Nov 19, 2024
  
  fc7db442
- update torch version · aa389394
  zhuwenwen authored Nov 19, 2024
  
  aa389394
- support bw · 3bb51ca2
  zhuwenwen authored Nov 19, 2024
  
  3bb51ca2
- Merge remote-tracking branch 'origin/vllm-0.6.2-zhagnshao' into v0.6.2-dev · 2f987dde
  zhuwenwen authored Nov 19, 2024
  
  2f987dde
- Merge branch 'v0.6.2-dev_wm' into 'v0.6.2-dev' · 99f557d2
  zhuwenwen authored Nov 19, 2024
```
[fix]解决单测test_encode报错问题

See merge request dcutoolkit/deeplearing/vllm!35
```
  99f557d2
- 增加bw支持 · c5877810
  zhangshao authored Nov 19, 2024
  
  c5877810
- [fix]解决单测test_encode报错问题 · 4e23f2ad
  王敏 authored Nov 19, 2024
  
  4e23f2ad
18 Nov, 2024 6 commits
- update test_basic_correctness.py · a715dfbe
  zhuwenwen authored Nov 18, 2024
  
  a715dfbe
- Merge branch 'v0.6.2-dev_wm' into 'v0.6.2-dev' · 4e06836d
  zhuwenwen authored Nov 18, 2024
```
[fix]修复test_spec_decode_worker中的错误

See merge request dcutoolkit/deeplearing/vllm!34
```
  4e06836d
- [fix]解决test_model_input中报的找不到move_cache错误 · 4d29e0a8
  王敏 authored Nov 18, 2024
  
  4d29e0a8
- [fix]解决test_model_input中报的找不到move_cache错误 · 16d88e40
  王敏 authored Nov 18, 2024
  
  16d88e40
- Merge remote-tracking branch 'origin/v0.6.2-dev' into v0.6.2-dev · 6d13278b
  王敏 authored Nov 18, 2024
  
  6d13278b
- [fix]修复test_spec_decode_worker中的错误 · dc2ce261
  王敏 authored Nov 18, 2024
  
  dc2ce261
15 Nov, 2024 5 commits
- Merge branch 'v0.6.2-dev_wm' into 'v0.6.2-dev' · aad58f06
  zhuwenwen authored Nov 15, 2024
```
修复单测中test_long_context、test_attention部分错误

See merge request dcutoolkit/deeplearing/vllm!33
```
  aad58f06
- [fix]修复单测test_punica_variation报共享内存不足的问题 · 137e8a16
  王敏 authored Nov 15, 2024
  
  137e8a16
- [fix]回退test_long_context中限制输入长度修改 · 9736caa9
  王敏 authored Nov 15, 2024
  
  9736caa9
- [fix]修复test_attention单测中paged_attention_v1和paged_attention_v2 opcheck找不到attn_masks错误 · fa57cb7f
  王敏 authored Nov 15, 2024
  
  fa57cb7f
- [fix]修复test_long_context中报错问题，单测依然无法通过，nv也是同样的问题 · 1d6cfb11
  王敏 authored Nov 15, 2024
  
  1d6cfb11
14 Nov, 2024 2 commits
- update setup.py · 70c661da
  zhuwenwen authored Nov 14, 2024
  
  70c661da
- update torch related deps · 85c45170
  zhuwenwen authored Nov 14, 2024
  
  85c45170
12 Nov, 2024 1 commit
- update idefics2_vision_model.py · 9a68d3a8
  zhuwenwen authored Nov 12, 2024
  
  9a68d3a8
10 Nov, 2024 1 commit
- update tests of kernels and basic_correctness · c012f7f6
  zhuwenwen authored Nov 10, 2024
  
  c012f7f6
07 Nov, 2024 3 commits
- remove xformers deps · 55c5f16f
  zhuwenwen authored Nov 07, 2024
  
  55c5f16f
- Merge branch 'v0.6.2-dev-wangmin' into 'v0.6.2-dev' · 32a996c5
  zhuwenwen authored Nov 07, 2024
```
Mixtral模型的gemm由TN改为NN

See merge request dcutoolkit/deeplearing/vllm!32
```
  32a996c5
- 1.Mixtral模型的gemm由TN改为NN · e7d022fd
  王敏 authored Nov 07, 2024
  
  e7d022fd
06 Nov, 2024 3 commits
- optimize qwen2-moe layout · 82aee745
  zhuwenwen authored Nov 06, 2024
  
  82aee745
- Merge branch 'v0.6.2-dev_medusa' into 'v0.6.2-dev' · 01df9361
  zhuwenwen authored Nov 06, 2024
```
修复medusa多卡推理和其他模型推理报错的问题

See merge request dcutoolkit/deeplearing/vllm!31
```
  01df9361
- 1.解决medusa模型多卡推理结果异常问题 · f9060e6b
  王敏 authored Nov 06, 2024
```
2.examples中添加medusa readme
3.修复model_runner中input_positions配置错误的笔误，解决多个模型运行失败问题
```
  f9060e6b
05 Nov, 2024 5 commits
- Merge remote-tracking branch 'origin/0.6.2-zhagnshao' into v0.6.2-dev · 505c5ff3
  zhuwenwen authored Nov 05, 2024
  
  505c5ff3
- Merge branch 'v0.6.2-eval' into v0.6.2-dev · 2b1b8c7d
  zhuwenwen authored Nov 05, 2024
  
  2b1b8c7d
- 解决pa tc 版读取Q矩阵时数组越界的问题 · 76058dcd
  zhangshao authored Nov 05, 2024
  
  76058dcd
- update readme · 367708c7
  zhuwenwen authored Nov 05, 2024
  
  367708c7
- update supported models · 3472235c
  zhuwenwen authored Nov 05, 2024
  
  3472235c
04 Nov, 2024 1 commit
- optimize qwen2-vl layout · a4167889
  zhuwenwen authored Nov 04, 2024
  
  a4167889
01 Nov, 2024 1 commit
- support multi image input of local files · a89ac72c
  zhuwenwen authored Nov 01, 2024
  
  a89ac72c
30 Oct, 2024 1 commit
- remove unused code · 04d33670
  zhuwenwen authored Oct 30, 2024
  
  04d33670