Commits · 0be169adae8957bfbc8f2ad6455c090525d7ac37 · OpenDAS / vllm_cscc

25 Mar, 2025 1 commit
- debug and fix some error about outputs · 0be169ad
  lizhigong authored Mar 25, 2025
  
  0be169ad
24 Mar, 2025 5 commits
- seq.data._effective_length+=1 · 18b9f67c
  guanyu1 authored Mar 24, 2025
  
  18b9f67c
- detok补充 · 6d0996e9
  guanyu1 authored Mar 24, 2025
  
  6d0996e9
- detok修改 · 3a49f3d2
  guanyu1 authored Mar 24, 2025
  
  3a49f3d2
- detok修改 · 052059d9
  guanyu1 authored Mar 24, 2025
  
  052059d9
- use two thread in step too improve first tokens · 2344d22e
  lizhigong authored Mar 24, 2025
  
  2344d22e
19 Mar, 2025 1 commit
- debug zero overhead · b78549c2
  lizhigong authored Mar 19, 2025
  
  b78549c2
18 Mar, 2025 1 commit
- fix llm_engine to zero_overhead · 7d867671
  lizhigong authored Mar 18, 2025
  
  7d867671
17 Mar, 2025 2 commits
- sampler修改 · 08c2298a
  guanyu1 authored Mar 17, 2025
  
  08c2298a
- zero overhead engine update · 9bd32639
  lizhigong authored Mar 17, 2025
  
  9bd32639
26 Feb, 2025 6 commits
- [fix]修复ds3量化代码引入的报错 · bcce8974
  王敏 authored Feb 26, 2025
  
  bcce8974
- [feat]合入ds3 MTP功能 · 1fbdf957
  王敏 authored Feb 26, 2025
  
  1fbdf957
- 解决cudagraph计算错误的问题 · d365012a
  zhangshao authored Feb 26, 2025
  
  d365012a
- update deepseek-v2 · 96802ca0
  zhuwenwen authored Feb 26, 2025
  
  96802ca0
- add cudagraph · 4d4c6fe3
  zhuwenwen authored Feb 26, 2025
  
  4d4c6fe3
- allow to set --enforce-eager · 537e2d9c
  zhuwenwen authored Feb 26, 2025
  
  537e2d9c
25 Feb, 2025 1 commit
- update version · 76621631
  zhuwenwen authored Feb 25, 2025
  
  76621631
22 Feb, 2025 3 commits
- update qwen2_vl nn lyaout · 437e6aef
  zhuwenwen authored Feb 22, 2025
  
  437e6aef
- set enforce eager · 7f881746
  zhuwenwen authored Feb 22, 2025
  
  7f881746
- support qwen2_5-vl · 0a89b8a3
  zhuwenwen authored Feb 22, 2025
  
  0a89b8a3
20 Feb, 2025 2 commits
- 适配deepseekv3\v2 moe awq的推理支持 · 47bd229c
  yangql authored Feb 20, 2025
  
  47bd229c
- skip fp8 fusion · 4a734b9d
  zhuwenwen authored Feb 20, 2025
  
  4a734b9d
19 Feb, 2025 2 commits
- add deepseek-v2 tp2 fused_moe_config · 177520a9
  zhuwenwen authored Feb 19, 2025
  
  177520a9
- update lm_head tn layout for awq · f0e7d72d
  zhuwenwen authored Feb 19, 2025
  
  f0e7d72d
18 Feb, 2025 3 commits
- add deepseek-v2 tp1 fused_moe_config · f0ac5f23
  zhuwenwen authored Feb 18, 2025
  
  f0ac5f23
- 增加lm_nn的量化控控控制,控制为tn · 41d0696e
  gaoqiong authored Feb 18, 2025
  
  41d0696e
- 添加w8a8 关于0.7.2的修改 · 8c61b2ed
  gaoqiong authored Feb 18, 2025
  
  8c61b2ed
17 Feb, 2025 1 commit
- [fix]1.解决deepseekv2/v3 nn layout加载报错问题;2.上传ep1和ep2的fused_moe config · 249fca2a
  王敏 authored Feb 17, 2025
  
  249fca2a
13 Feb, 2025 4 commits
- support deepseek_v2 nn layout · a8b2d878
  zhuwenwen authored Feb 13, 2025
  
  a8b2d878
- 修复mixtral.py · 90a5cf7a
  王敏 authored Feb 13, 2025
  
  90a5cf7a
- 解决合并冲突 · c2ed66f0
  王敏 authored Feb 13, 2025
  
  c2ed66f0
- 添加moe模型部分fused_moe config · a10c70e7
  王敏 authored Feb 13, 2025
  
  a10c70e7
12 Feb, 2025 2 commits
- 优化ep moe · 44d451ff
  王敏 authored Feb 12, 2025
  
  44d451ff
- update mixtral.py · 3920c549
  zhuwenwen authored Feb 12, 2025
  
  3920c549
11 Feb, 2025 5 commits
- 修改错误代码 · 36e35fac
  王敏 authored Feb 11, 2025
  
  36e35fac
- 添加ep moe tuning · 10213be4
  王敏 authored Feb 11, 2025
  
  10213be4
- [feat]添加ep moe功能 · d0dafaf4
  王敏 authored Feb 11, 2025
  
  d0dafaf4
- update fused_moe.py · a27fdb55
  zhuwenwen authored Feb 11, 2025
  
  a27fdb55
- add latency · 49bfe4cb
  zhuwenwen authored Feb 11, 2025
  
  49bfe4cb
10 Feb, 2025 1 commit
- [feat]适配0.7.2版本的deepseek_v3 nn layout · 70deb5ef
  王敏 authored Feb 10, 2025
  
  70deb5ef