Skip to content

GitLab

Unverified Commit dec6fc6f authored by Antoni Baum's avatar Antoni Baum Committed by GitHub
Browse files

[Bugfix] Use RayActorError for older versions of Ray in RayTokenizerGroupPool (#6039)

parent 8893130b
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 1 deletion
vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py
View file @ dec6fc6f
...@@ -2,7 +2,11 @@ import asyncio ...@@ -2,7 +2,11 @@ import asyncio
import os import os
from typing import List, Optional from typing import List, Optional
from ray.exceptions import ActorDiedError try:
from ray.exceptions import ActorDiedError
except ImportError:
# For older versions of Ray
from ray.exceptions import RayActorError as ActorDiedError
from ray.util.scheduling_strategies import NodeAffinitySchedulingStrategy from ray.util.scheduling_strategies import NodeAffinitySchedulingStrategy
from transformers import PreTrainedTokenizer from transformers import PreTrainedTokenizer
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment