Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
cf90ae01
Unverified
Commit
cf90ae01
authored
Jun 22, 2024
by
Kunshang Ji
Committed by
GitHub
Jun 21, 2024
Browse files
[CI][Hardware][Intel GPU] add Intel GPU(XPU) ci pipeline (#5616)
parent
f5dda63e
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
9 additions
and
3 deletions
+9
-3
.buildkite/test-template-aws.j2
.buildkite/test-template-aws.j2
+8
-2
README.md
README.md
+1
-1
No files found.
.buildkite/test-template-aws.j2
View file @
cf90ae01
...
@@ -42,12 +42,18 @@ steps:
...
@@ -42,12 +42,18 @@ steps:
command: bash .buildkite/run-neuron-test.sh
command: bash .buildkite/run-neuron-test.sh
soft_fail: false
soft_fail: false
- label: "Intel Test"
- label: "Intel
CPU
Test"
depends_on: ~
depends_on: ~
agents:
agents:
queue: intel
queue: intel
-cpu
command: bash .buildkite/run-cpu-test.sh
command: bash .buildkite/run-cpu-test.sh
- label: "Intel GPU Test"
depends_on: ~
agents:
queue: intel-gpu
command: bash .buildkite/run-xpu-test.sh
{% for step in steps %}
{% for step in steps %}
{% if step.gpu == "a100" %}
{% if step.gpu == "a100" %}
- label: "{{ step.label }}"
- label: "{{ step.label }}"
...
...
README.md
View file @
cf90ae01
...
@@ -59,7 +59,7 @@ vLLM is flexible and easy to use with:
...
@@ -59,7 +59,7 @@ vLLM is flexible and easy to use with:
-
Tensor parallelism support for distributed inference
-
Tensor parallelism support for distributed inference
-
Streaming outputs
-
Streaming outputs
-
OpenAI-compatible API server
-
OpenAI-compatible API server
-
Support NVIDIA GPUs, AMD GPUs,
and
Intel CPUs
-
Support NVIDIA GPUs, AMD GPUs, Intel CPUs
and GPUs
-
(Experimental) Prefix caching support
-
(Experimental) Prefix caching support
-
(Experimental) Multi-lora support
-
(Experimental) Multi-lora support
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment