fixed a bug related to scale tuning

95827f48 · Shucai Xiao · debed772 · 95827f48
Commit 95827f48 authored Sep 04, 2019 by Shucai Xiao
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 2 deletions

src/quantization.cpp src/quantization.cpp +1 -2

No files found.
--- a/src/quantization.cpp
+++ b/src/quantization.cpp
@@ -264,8 +264,7 @@ static void ins_quantize_int8(program& prog,
        auto dilation     = conv_op.dilation;
        auto padding_mode = conv_op.padding_mode;
        auto group        = conv_op.group;
-        auto adjust_factor =
+        auto adjust_factor = 1.0f / (ins_quant_params[0].first * ins_quant_params[1].first);
-            std::round(1.0f / (ins_quant_params[0].first * ins_quant_params[1].first));
        auto quant_conv = prog.insert_instruction(
            ins,