Merge branch 'ds-v0.8.2-rocm' into 'main'

Ds v0.8.2 rocm, support torch1.13 for the hipify change See merge request aicomponent/deepspeed!1

Merge branch 'ds-v0.8.2-rocm' into 'main'
Ds v0.8.2 rocm, support torch1.13 for the hipify change See merge request aicomponent/deepspeed!1
899b52ce · aiss · 67ea635f · 4acf0e01 · 67ea635f · 67ea635f
Commit 899b52ce authored Apr 26, 2023 by aiss
20 changed files
--- a/csrc/transformer/inference/includes/context_hip.h
+++ b/csrc/transformer/inference/includes/context_hip.h
--- a/csrc/transformer/inference/includes/cublas_wrappers_hip.h
+++ b/csrc/transformer/inference/includes/cublas_wrappers_hip.h
--- a/csrc/transformer/inference/includes/custom_hip_layers.h
+++ b/csrc/transformer/inference/includes/custom_hip_layers.h
--- a/csrc/transformer/inference/includes/inference_context_hip.h
+++ b/csrc/transformer/inference/includes/inference_context_hip.h
--- a/csrc/transformer/inference/includes/inference_cublas_wrappers_hip.h
+++ b/csrc/transformer/inference/includes/inference_cublas_wrappers_hip.h
--- a/csrc/transformer/inference/includes/inference_hip_layers.h
+++ b/csrc/transformer/inference/includes/inference_hip_layers.h
--- a/csrc/transformer/normalize_kernels.hip
+++ b/csrc/transformer/normalize_kernels.hip
--- a/csrc/transformer/softmax_kernels.hip
+++ b/csrc/transformer/softmax_kernels.hip
--- a/csrc/transformer/transform_kernels.hip
+++ b/csrc/transformer/transform_kernels.hip
--- a/csrc/transformer_bak/cublas_wrappers.cu
+++ b/csrc/transformer_bak/cublas_wrappers.cu
--- a/csrc/transformer_bak/cublas_wrappers.hip
+++ b/csrc/transformer_bak/cublas_wrappers.hip
--- a/csrc/transformer_bak/dropout_kernels.cu
+++ b/csrc/transformer_bak/dropout_kernels.cu
--- a/csrc/transformer_bak/dropout_kernels.hip
+++ b/csrc/transformer_bak/dropout_kernels.hip
--- a/csrc/transformer_bak/ds_transformer_cuda.cpp
+++ b/csrc/transformer_bak/ds_transformer_cuda.cpp
--- a/csrc/transformer_bak/ds_transformer_hip.cpp
+++ b/csrc/transformer_bak/ds_transformer_hip.cpp
--- a/csrc/transformer_bak/gelu_kernels.cu
+++ b/csrc/transformer_bak/gelu_kernels.cu
--- a/csrc/transformer_bak/gelu_kernels.hip
+++ b/csrc/transformer_bak/gelu_kernels.hip
--- a/csrc/transformer_bak/general_kernels.cu
+++ b/csrc/transformer_bak/general_kernels.cu
--- a/csrc/transformer_bak/general_kernels.hip
+++ b/csrc/transformer_bak/general_kernels.hip
--- a/csrc/transformer_bak/inference/csrc/apply_rotary_pos_emb.cu
+++ b/csrc/transformer_bak/inference/csrc/apply_rotary_pos_emb.cu