Unverified Commit 7543e275 authored by Wang, Yi's avatar Wang, Yi Committed by GitHub
Browse files

update doc for perf_train_cpu_many (#19506)


Signed-off-by: default avatarWang, Yi A <yi.a.wang@intel.com>
Signed-off-by: default avatarWang, Yi A <yi.a.wang@intel.com>
parent bb2cfd18
...@@ -116,5 +116,5 @@ You could define your own compute_objective function, if not defined, the defaul ...@@ -116,5 +116,5 @@ You could define your own compute_objective function, if not defined, the defaul
... ) ... )
``` ```
## Hyperparameter search For DDP refinetune ## Hyperparameter search For DDP finetune
Currently, Hyperparameter search for DDP is enabled for optuna and sigopt. Only the rank-zero process will generate the search trial and pass the argument to other ranks. Currently, Hyperparameter search for DDP is enabled for optuna and sigopt. Only the rank-zero process will generate the search trial and pass the argument to other ranks.
\ No newline at end of file
...@@ -27,6 +27,7 @@ Wheel files are available for the following Python versions: ...@@ -27,6 +27,7 @@ Wheel files are available for the following Python versions:
| Extension Version | Python 3.6 | Python 3.7 | Python 3.8 | Python 3.9 | Python 3.10 | | Extension Version | Python 3.6 | Python 3.7 | Python 3.8 | Python 3.9 | Python 3.10 |
| :---------------: | :--------: | :--------: | :--------: | :--------: | :---------: | | :---------------: | :--------: | :--------: | :--------: | :--------: | :---------: |
| 1.12.100 | | √ | √ | √ | √ |
| 1.12.0 | | √ | √ | √ | √ | | 1.12.0 | | √ | √ | √ | √ |
| 1.11.0 | | √ | √ | √ | √ | | 1.11.0 | | √ | √ | √ | √ |
| 1.10.0 | √ | √ | √ | √ | | | 1.10.0 | √ | √ | √ | √ | |
...@@ -41,6 +42,7 @@ Versions of oneCCL and PyTorch must match. ...@@ -41,6 +42,7 @@ Versions of oneCCL and PyTorch must match.
<Tip warning={true}> <Tip warning={true}>
oneccl_bindings_for_pytorch 1.12.0 prebuilt wheel does not work with PyTorch 1.12.1 (it is for PyTorch 1.12.0) oneccl_bindings_for_pytorch 1.12.0 prebuilt wheel does not work with PyTorch 1.12.1 (it is for PyTorch 1.12.0)
PyTorch 1.12.1 should work with oneccl_bindings_for_pytorch 1.12.100
</Tip> </Tip>
...@@ -49,7 +51,7 @@ Use this standards-based MPI implementation to deliver flexible, efficient, scal ...@@ -49,7 +51,7 @@ Use this standards-based MPI implementation to deliver flexible, efficient, scal
oneccl_bindings_for_pytorch is installed along with the MPI tool set. Need to source the environment before using it. oneccl_bindings_for_pytorch is installed along with the MPI tool set. Need to source the environment before using it.
for Intel® oneCCL 1.12.0 for Intel® oneCCL >= 1.12.0
``` ```
oneccl_bindings_for_pytorch_path=$(python -c "from oneccl_bindings_for_pytorch import cwd; print(cwd)") oneccl_bindings_for_pytorch_path=$(python -c "from oneccl_bindings_for_pytorch import cwd; print(cwd)")
source $oneccl_bindings_for_pytorch_path/env/setvars.sh source $oneccl_bindings_for_pytorch_path/env/setvars.sh
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment