First add

d3dd8642 · Rayyyyy · d3dd8642 · d3dd8642 · d3dd8642 · d3dd8642
Commit d3dd8642 authored Jun 26, 2024 by Rayyyyy
20 changed files
--- a/vllm/examples/tensorize_vllm_model.py
+++ b/vllm/examples/tensorize_vllm_model.py
--- a/vllm/format.sh
+++ b/vllm/format.sh
--- a/vllm/humaneval/.vLLM_inference.py.swp
+++ b/vllm/humaneval/.vLLM_inference.py.swp
--- a/vllm/humaneval/HumanEval.jsonl
+++ b/vllm/humaneval/HumanEval.jsonl
--- a/vllm/humaneval/human-eval-gpt4-translation-fixed5.jsonl
+++ b/vllm/humaneval/human-eval-gpt4-translation-fixed5.jsonl
--- a/vllm/humaneval/samples.jsonl
+++ b/vllm/humaneval/samples.jsonl
--- a/vllm/humaneval/samples.jsonl_results.jsonl
+++ b/vllm/humaneval/samples.jsonl_results.jsonl
--- a/vllm/patch_xformers.rocm.sh
+++ b/vllm/patch_xformers.rocm.sh
--- a/vllm/pyproject.toml
+++ b/vllm/pyproject.toml
--- a/vllm/requirements-build.txt
+++ b/vllm/requirements-build.txt
--- a/vllm/requirements-common.txt
+++ b/vllm/requirements-common.txt
--- a/vllm/requirements-cpu.txt
+++ b/vllm/requirements-cpu.txt
--- a/vllm/requirements-cuda.txt
+++ b/vllm/requirements-cuda.txt
--- a/vllm/requirements-dev.txt
+++ b/vllm/requirements-dev.txt
--- a/vllm/requirements-neuron.txt
+++ b/vllm/requirements-neuron.txt
--- a/vllm/requirements-rocm.txt
+++ b/vllm/requirements-rocm.txt
--- a/vllm/rocm_patch/commonpy_xformers-0.0.23.rocm.patch
+++ b/vllm/rocm_patch/commonpy_xformers-0.0.23.rocm.patch
--- a/vllm/rocm_patch/flashpy_xformers-0.0.23.rocm.patch
+++ b/vllm/rocm_patch/flashpy_xformers-0.0.23.rocm.patch
--- a/vllm/rocm_patch/rocm_bf16.patch
+++ b/vllm/rocm_patch/rocm_bf16.patch
--- a/vllm/setup.py
+++ b/vllm/setup.py