修复turbomind从hf读模型时存在bf16不支持的问题

5f5a62dd · zhouxiang · 9b3cb662 · 5f5a62dd
Commit 5f5a62dd authored May 15, 2024 by zhouxiang
Show whitespace changes
Inline Side-by-side

Showing with 3 additions and 3 deletions

lmdeploy/turbomind/turbomind.py lmdeploy/turbomind/turbomind.py +3 -3

No files found.
--- a/lmdeploy/turbomind/turbomind.py
+++ b/lmdeploy/turbomind/turbomind.py
@@ -305,9 +305,9 @@ class TurboMind:
            data_type = 'int4'
            cfg.group_size = 128
        else:
-            output_format = update_output_format(cfg.model_name,
-                                                 inferred_model_format,
-                                                 model_path, output_format)
+            # output_format = update_output_format(cfg.model_name,
+            #                                      inferred_model_format,
+            #                                      model_path, output_format)
            data_type = output_format
            update_config_weight_type(output_format, cfg)