Commit c59d7aca authored by Kun Lin's avatar Kun Lin Committed by Hongxin Liu
Browse files

Feature/vit support (#4182)

* [shardformer] added tests

* [shardformer] vit test finish and support

* fix attention dropout
parent 0ceec8f9
from functools import partial
from typing import Callable, Dict, List, Union
import torch.nn as nn
......@@ -86,6 +85,8 @@ class ViTPolicy(Policy):
return policy
return policy
def new_model_class(self):
return None
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment