GitLab

issue/261: optimize the torch implementation of add, causal softmax, gemm, random sample, rearrange, rms norm, rope

同时修复 CPU rearrange 算子内存泄漏问题

使用maskedInplaceOp和SoftmaxOp实现CausalSoftmaxOp

issue/127: Refactor ElementwiseInfo, refactor elementwise to use workspace for storing meta, fix misc. issues

issue/127: modify swiglu test to correctly handle broadcast scenarios, add two broadcast testcases, correct elementwise cpu mix-precision implementation

* issue/108: failed to create ops descriptor

* issue/108: add result tensor and modified random_sample.py

* issue/108: success random sample

* issue/108: modified tostring

* issue/108: modified format and sample function

* issue/108: modified data sample function name

Signed-off-by: YdrMaster <ydrml@hotmail.com>

Signed-off-by: YdrMaster <ydrml@hotmail.com>