Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements-infer.txt 233 Bytes
Newer Older
Xu Kai's avatar
[inference] Refactor inference architecture (#5057)  
Xu Kai committed
1
2
3
4 
transformers==4.34.0
packaging
ninja
auto-gptq==0.5.0
Cuiqing Li (李崔卿)'s avatar
[Kernels]added flash-decoidng of triton (#5063)  
Cuiqing Li (李崔卿) committed
5 
git+https://github.com/ModelTC/lightllm.git@ece7b43f8a6dfa74027adc77c2c176cff28c76c8
Xu Kai's avatar
[inference] Refactor inference architecture (#5057)  
Xu Kai committed
6 
git+https://github.com/Dao-AILab/flash-attention.git@017716451d446e464dde9aca3a3c1ed2209caaa9