Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Zhongkai Zhao's avatar
    [feature] support no master weights option for low level zero plugin (#4816) · a0684e7b
    Zhongkai Zhao authored 
    * [feature] support no master weights for low level zero plugin

* [feature] support no master weights for low level zero plugin, remove data copy when no master weights

* remove data copy and typecasting when no master weights

* not load weights to cpu when using no master weights

* fix grad: use fp16 grad when no master weights

* only do not update working param when no master weights

* fix: only do not update working param when no master weights

* fix: passing params in dict format in hybrid plugin

* fix: remove extra params (tp_process_group) in hybrid_parallel_plugin
    a0684e7b
low_level_zero_plugin.py 14.5 KB