Unverified Commit c4d859c2 authored by Tushar Shetty's avatar Tushar Shetty Committed by GitHub
Browse files

[Bugfix] Skip out-of-stage layers in get_layers_from_vllm_config for pipeline parallel (#36243)


Signed-off-by: default avatarTushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: default avatarTushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
parent 74743104
......@@ -1795,5 +1795,6 @@ def get_layers_from_vllm_config(
return {
layer_name: forward_context[layer_name]
for layer_name in layer_names
if isinstance(forward_context[layer_name], layer_type)
if layer_name in forward_context
and isinstance(forward_context[layer_name], layer_type)
}
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment