Clip device map (#19409)

* add first generation tutorial * uP * [Clip] Add text model to device map

Clip device map (#19409)
* add first generation tutorial * uP * [Clip] Add text model to device map
06514b3e · Patrick von Platen · GitHub · c2b83d54 · 06514b3e
Unverified Commit 06514b3e authored Oct 07, 2022 by Patrick von Platen Committed by GitHub Oct 07, 2022
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

src/transformers/models/clip/modeling_clip.py src/transformers/models/clip/modeling_clip.py +2 -0

No files found.
--- a/src/transformers/models/clip/modeling_clip.py
+++ b/src/transformers/models/clip/modeling_clip.py
@@ -688,6 +688,8 @@ class CLIPTextTransformer(nn.Module):
 class CLIPTextModel(CLIPPreTrainedModel):
    config_class = CLIPTextConfig

+    _no_split_modules = ["CLIPEncoderLayer"]
+
    def __init__(self, config: CLIPTextConfig):
        super().__init__(config)
        self.text_model = CLIPTextTransformer(config)