Skip to content

GitLab

Commit f03f72de authored by Casper Hansen's avatar Casper Hansen
Browse files

Falcon: Enable fused attention

parent ac770875
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
awq/models/falcon.py
View file @ f03f72de
...@@ -7,7 +7,7 @@ class FalconAWQForCausalLM(BaseAWQForCausalLM): ...@@ -7,7 +7,7 @@ class FalconAWQForCausalLM(BaseAWQForCausalLM):
@staticmethod @staticmethod
def fuse_layers(model: FalconForCausalLM, quant_config:dict): def fuse_layers(model: FalconForCausalLM, quant_config:dict):
fuser = FalconFuser(model) fuser = FalconFuser(model)
# fuser.fuse_transformer() fuser.fuse_transformer()
@staticmethod @staticmethod
def get_model_layers(model: FalconForCausalLM): def get_model_layers(model: FalconForCausalLM):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment