Commit 7d4a3e22 authored by ys-2020's avatar ys-2020
Browse files

[Minor] require torch>=2.0.0

parent e56bd25a
...@@ -49,7 +49,7 @@ pip install -e . ...@@ -49,7 +49,7 @@ pip install -e .
* For **edge devices** like Orin, before running the commands above, please: * For **edge devices** like Orin, before running the commands above, please:
1. Modify [pyproject.toml](pyproject.toml) by commenting out [this line](https://github.com/mit-han-lab/llm-awq/blob/3fce69061682fdd528824e5da3d03a8a8b545f2a/pyproject.toml#L17). 1. Modify [pyproject.toml](pyproject.toml) by commenting out [this line](https://github.com/mit-han-lab/llm-awq/blob/3fce69061682fdd528824e5da3d03a8a8b545f2a/pyproject.toml#L17).
2. Manually install precompiled PyTorch binaries from [NVIDIA](https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048). 2. Manually install precompiled PyTorch binaries (>=2.0.0) from [NVIDIA](https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048).
3. Set the appropriate Python version for conda environment (e.g., `conda create -n awq python=3.8 -y` for JetPack 5). 3. Set the appropriate Python version for conda environment (e.g., `conda create -n awq python=3.8 -y` for JetPack 5).
3. Install efficient W4A16 (4-bit weight, 16-bit activation) CUDA kernel and optimized FP16 kernels (e.g. layernorm, positional encodings). 3. Install efficient W4A16 (4-bit weight, 16-bit activation) CUDA kernel and optimized FP16 kernels (e.g. layernorm, positional encodings).
......
...@@ -14,7 +14,7 @@ classifiers = [ ...@@ -14,7 +14,7 @@ classifiers = [
] ]
dependencies = [ dependencies = [
"accelerate", "sentencepiece", "tokenizers>=0.12.1", "accelerate", "sentencepiece", "tokenizers>=0.12.1",
"torch", "torchvision", "torch>=2.0.0", "torchvision",
"transformers>=4.31.0", "transformers>=4.31.0",
"lm_eval", "texttable", "lm_eval", "texttable",
"toml", "attributedict", "toml", "attributedict",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment