Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
d675d221
Unverified
Commit
d675d221
authored
May 08, 2025
by
Biswa Panda
Committed by
GitHub
May 09, 2025
Browse files
feat: decouple dynamo sdk to support mutiple deployment targets (#905)
parent
5d5235bc
Changes
46
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
0 additions
and
6 deletions
+0
-6
examples/sglang/components/worker.py
examples/sglang/components/worker.py
+0
-1
examples/tensorrt_llm/components/frontend.py
examples/tensorrt_llm/components/frontend.py
+0
-1
examples/tensorrt_llm/components/kv_router.py
examples/tensorrt_llm/components/kv_router.py
+0
-1
examples/tensorrt_llm/components/prefill_worker.py
examples/tensorrt_llm/components/prefill_worker.py
+0
-1
examples/tensorrt_llm/components/processor.py
examples/tensorrt_llm/components/processor.py
+0
-1
examples/tensorrt_llm/components/worker.py
examples/tensorrt_llm/components/worker.py
+0
-1
No files found.
examples/sglang/components/worker.py
View file @
d675d221
...
...
@@ -39,7 +39,6 @@ logger = logging.getLogger(__name__)
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"gpu"
:
1
},
...
...
examples/tensorrt_llm/components/frontend.py
View file @
d675d221
...
...
@@ -48,7 +48,6 @@ class FrontendConfig(BaseModel):
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"cpu"
:
"10"
,
"memory"
:
"20Gi"
},
...
...
examples/tensorrt_llm/components/kv_router.py
View file @
d675d221
...
...
@@ -68,7 +68,6 @@ def parse_args(service_name, prefix) -> Namespace:
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"cpu"
:
"10"
,
"memory"
:
"20Gi"
},
...
...
examples/tensorrt_llm/components/prefill_worker.py
View file @
d675d221
...
...
@@ -28,7 +28,6 @@ logger = logging.getLogger(__name__)
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"gpu"
:
1
,
"cpu"
:
"10"
,
"memory"
:
"20Gi"
},
...
...
examples/tensorrt_llm/components/processor.py
View file @
d675d221
...
...
@@ -35,7 +35,6 @@ logger = logging.getLogger(__name__)
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"cpu"
:
"10"
,
"memory"
:
"20Gi"
},
...
...
examples/tensorrt_llm/components/worker.py
View file @
d675d221
...
...
@@ -29,7 +29,6 @@ logger = logging.getLogger(__name__)
@
service
(
dynamo
=
{
"enabled"
:
True
,
"namespace"
:
"dynamo"
,
},
resources
=
{
"gpu"
:
1
,
"cpu"
:
"10"
,
"memory"
:
"20Gi"
},
...
...
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment