Skip to content

GitLab

"vllm_omni/distributed/__init__.py" did not exist on "356077823ea8569ff15218e51228c1b3d50792a9"
Switch branch/tag
Find file BlameHistoryPermalink
  • one's avatar
    Runner: Add local numactl GPU affinity support (#6) · 0993db75
    one authored 
    - Add `numactl` support for local runner modes, including `cpunodebind`, `membind`, and `physcpubind`.
- Add `gpu_affinity` resolution through `sb node topo --get gpu-numa-affinity --gpu-id`.
- Add `sb node topo` support for GPU NUMA topology queries.
- Update BW1000 config to use the new local `numactl` semantics.
- Document the new `numactl` mode fields and limitations.
    0993db75
test_runner.py 27.6 KB