"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "ba71bf4caedaa90a11f02735eb8bb375aabe70f5"
Commit 302146a7 authored by chenzk's avatar chenzk
Browse files

v1.0.1

parent a380ace2
...@@ -110,11 +110,13 @@ pip install --no-deps "trl<0.9.0" peft accelerate bitsandbytes ...@@ -110,11 +110,13 @@ pip install --no-deps "trl<0.9.0" peft accelerate bitsandbytes
Do **NOT** use this if you have Anaconda. You must use the Conda install method, or else stuff will BREAK. Do **NOT** use this if you have Anaconda. You must use the Conda install method, or else stuff will BREAK.
For DCU(dtk24.04.1、Pytorch 2.1.0): For DCU(dtk24.04.1、Pytorch 2.1.0):
```
cd unsloth cd unsloth
pip install . pip install .
```
``` ```
# modified unsloth # if modify unsloth by yourself, then you can gitclone and use the newest of author:
vim unsloth/kernels/cross_entropy_loss.py: vim unsloth/kernels/cross_entropy_loss.py:
MAX_FUSED_SIZE = 65536 -> MAX_FUSED_SIZE = 16384 MAX_FUSED_SIZE = 65536 -> MAX_FUSED_SIZE = 16384
num_warps = 32 -> num_warps = 8 # 位于Fast_CrossEntropyLoss类的_chunked_cross_entropy_forward[(n_rows, n_chunks,)]下面 num_warps = 32 -> num_warps = 8 # 位于Fast_CrossEntropyLoss类的_chunked_cross_entropy_forward[(n_rows, n_chunks,)]下面
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment