Commit 7dceb45f authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-yql' into 'v0.9.2-dev'

修复awq 的mtp中的blockint8的问题

See merge request dcutoolkit/deeplearing/vllm!229
parents 1b98d0bb 0cc9bc74
......@@ -517,4 +517,5 @@ class BlockInt8MoEMethod:
block_shape=self.quant_config.weight_block_size,
use_nn_moe=use_nn_moe,
shared_output=shared_output,
routed_scaling_factor=routed_scaling_factor,
)
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment