GitLab

Wrap wait_for_deployment_ready() in try/except TimeoutError for both prefill and decode profiling sweeps
On timeout: log error, record via add_profiling_error(), clean up the timed-out deployment, and continue to the next parallelization mapping
Previously, a single deployment timeout would crash the entire profiler job

feat: remove default model name in Profiler; validate for one of served model name and model path in Profiler (#5950)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

Extends the MOE planner profiler to support  TEP (tensor expert parallel) and DEP (data expert parallel) configs with the vllm backend

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: Tushar Sharma <tusharma@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: Jason Zhou <jasonzho@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

Signed-off-by: Anant Sharma <anants@nvidia.com>

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>