"docker/Dockerfile.neuron" did not exist on "0f3f3c86ec44467fa80b60cb9f971f9ede028f76"
- 09 Aug, 2024 1 commit
-
-
gaoqiong authored
-
- 06 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 04 Aug, 2024 1 commit
-
-
gaoqiong authored
-
- 26 Apr, 2024 1 commit
-
-
Cody Yu authored
-
- 23 Apr, 2024 1 commit
-
-
James Fleming authored
Co-authored-by:mgoin <michael@neuralmagic.com>
-
- 11 Apr, 2024 2 commits
-
-
Antoni Baum authored
-
Kunshang Ji authored
-
- 11 Mar, 2024 1 commit
-
-
Zhuohan Li authored
-
- 12 Feb, 2024 1 commit
-
-
Rex authored
Co-authored-by:Chunan Zeng <chunanzeng@Chunans-Air.attlocal.net>
-
- 01 Feb, 2024 1 commit
-
-
Kunshang Ji authored
Co-authored-by:
Jiang Li <jiang1.li@intel.com> Co-authored-by:
Kunshang Ji <kunshang.ji@intel.com>
-
- 27 Jan, 2024 1 commit
-
-
Casper authored
-
- 15 Dec, 2023 1 commit
-
-
CHU Tianxiang authored
-
- 24 Nov, 2023 1 commit
-
-
Yanming W authored
-
- 20 Nov, 2023 1 commit
-
-
Simon Mo authored
-
- 19 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 16 Nov, 2023 1 commit
-
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
