修改转模型bf16的问题。

d033914f · xiabo · fa47d0d8 · d033914f
Commit d033914f authored Jan 15, 2024 by xiabo
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 2 deletions

lmdeploy/turbomind/deploy/converter.py lmdeploy/turbomind/deploy/converter.py +2 -2

No files found.
--- a/lmdeploy/turbomind/deploy/converter.py
+++ b/lmdeploy/turbomind/deploy/converter.py
@@ -266,8 +266,8 @@ def main(model_name: str,
        output_format = 'w4'
        assert group_size > 0, f'group_size: {group_size} should > 0'
    else:
-        output_format = update_output_format(model_name, inferred_model_format,
-                                             model_path, output_format)
+        #output_format = update_output_format(model_name, inferred_model_format,
+        #                                     model_path, output_format)
        update_config_weight_type(output_format, cfg)

    # convert