Skip to content

GitLab

"lib/llm/tests/backend.rs" did not exist on "ffc6dde1f0c6a45ac2ed72e91139949992c9c55d"
Switch branch/tag
  1. 04 Apr, 2025 1 commit
    • Graham King's avatar
      feat: Python decorator dynamo_worker takes optional `static` parameter without etcd (#494) · 88ad3425
      Graham King authored 
      Adds `@dynamo_worker(static = True)` to create a static worker which has a predictable name and hence does not require discovery or `etcd` to be running. There can only be a single static worker per namespace / component / endpoint trio.

This contrasts with the default dynamic `dynamo_worker` endpoints we have now, which get a unique random name (based on namespace/component/endpoint), and are discovered by ingress components using etcd.

Also change the hello_world example to use `dynamo_worker(static = True)` so that it is exercised and demonstrated somewhere.

For NIM.
      88ad3425
  3. 24 Mar, 2025 1 commit
  5. 18 Mar, 2025 1 commit
  7. 17 Mar, 2025 3 commits