Add device arg to model_args passed to LLM object in VLLM model class (#2879)
* fix: pass device arg in model_ar in vllm_causallms * casting device arg to str in vLLM model args
Showing
Please register or sign in to comment
* fix: pass device arg in model_ar in vllm_causallms * casting device arg to str in vLLM model args