Skip to content

GitLab

Commit d033914f authored by xiabo's avatar xiabo
Browse files

修改转模型bf16的问题。

parent fa47d0d8
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lmdeploy/turbomind/deploy/converter.py
View file @ d033914f
...@@ -266,8 +266,8 @@ def main(model_name: str, ...@@ -266,8 +266,8 @@ def main(model_name: str,
output_format = 'w4' output_format = 'w4'
assert group_size > 0, f'group_size: {group_size} should > 0' assert group_size > 0, f'group_size: {group_size} should > 0'
else: else:
output_format = update_output_format(model_name, inferred_model_format, #output_format = update_output_format(model_name, inferred_model_format,
model_path, output_format) # model_path, output_format)
update_config_weight_type(output_format, cfg) update_config_weight_type(output_format, cfg)
# convert # convert
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment