Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
b92834c8
Commit
b92834c8
authored
Mar 16, 2025
by
Neelay Shah
Committed by
GitHub
Mar 17, 2025
Browse files
chore: removing outdated examples (#202)
parent
fd79234f
Changes
45
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
0 additions
and
488 deletions
+0
-488
examples/python_rs/llm/vllm/utils/prefill_queue.py
examples/python_rs/llm/vllm/utils/prefill_queue.py
+0
-56
examples/python_rs/llm/vllm/utils/protocol.py
examples/python_rs/llm/vllm/utils/protocol.py
+0
-116
examples/python_rs/llm/vllm/utils/vllm.py
examples/python_rs/llm/vllm/utils/vllm.py
+0
-51
examples/python_rs/llm/vllm/worker.py
examples/python_rs/llm/vllm/worker.py
+0
-229
examples/tests/test_gpu_sanity.py
examples/tests/test_gpu_sanity.py
+0
-36
No files found.
examples/python_rs/llm/vllm/utils/prefill_queue.py
deleted
100644 → 0
View file @
fd79234f
# SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
from
typing
import
Optional
import
msgspec
from
utils.nats_queue
import
NATSQueue
from
vllm.remote_prefill
import
RemotePrefillRequest
class
PrefillQueue
(
NATSQueue
):
"""
A wrapper of NATSQueue for PrefillRequest.
The stream name is forced to be "prefill_queue".
"""
def
__init__
(
self
,
stream_name
=
"prefill_queue"
,
nats_server
:
str
=
"nats://localhost:4222"
,
dequeue_timeout
:
float
=
1
,
):
super
().
__init__
(
stream_name
=
stream_name
,
nats_server
=
nats_server
,
dequeue_timeout
=
dequeue_timeout
,
)
async
def
enqueue_prefill_request
(
self
,
prefill_request
:
RemotePrefillRequest
)
->
None
:
encoded_request
=
msgspec
.
json
.
encode
(
prefill_request
)
await
self
.
enqueue_task
(
encoded_request
)
async
def
dequeue_prefill_request
(
self
)
->
Optional
[
RemotePrefillRequest
]:
encoded_request
=
await
self
.
dequeue_task
()
if
encoded_request
is
not
None
:
prefill_request
=
msgspec
.
json
.
decode
(
encoded_request
,
type
=
RemotePrefillRequest
)
return
prefill_request
else
:
return
None
examples/python_rs/llm/vllm/utils/protocol.py
deleted
100644 → 0
View file @
fd79234f
This diff is collapsed.
Click to expand it.
examples/python_rs/llm/vllm/utils/vllm.py
deleted
100644 → 0
View file @
fd79234f
This diff is collapsed.
Click to expand it.
examples/python_rs/llm/vllm/worker.py
deleted
100644 → 0
View file @
fd79234f
This diff is collapsed.
Click to expand it.
examples/tests/test_gpu_sanity.py
deleted
100644 → 0
View file @
fd79234f
This diff is collapsed.
Click to expand it.
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment