tgi用哪个版本的pytorch镜像能安装成功
能否给个具体安装镜像版本的说明,我用k100安装,用dtk23.10.1,dtk24.04,dtk24.04.1,安装定制版vllm或最终安装tgi时,都会有报错
24.04.1和23.10.1,都是卡在 make install-vllm
File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1777, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2119, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
make: *** [Makefile:9: install-vllm] Error 1
这是24.04最后一步安装tgi的报错
WARNING: Error parsing dependencies of lmdeploy: Invalid version: '0.1.0-git782048c.abi0.dtk2404.torch2.1.'
WARNING: Error parsing dependencies of mmcv: Invalid version: '2.0.1-gitc0ccf15.abi0.dtk2404.torch2.1.'
ERROR: Exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 105, in _run_wrapper
status = _inner_run()
File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 96, in _inner_run
return self.run(options, args)
File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 67, in wrapper
return func(self, options, args)
File "/usr/local/lib/python3.10/site-packages/pip/_internal/commands/install.py", line 483, in run
installed_versions[distribution.canonical_name] = distribution.version
File "/usr/local/lib/python3.10/site-packages/pip/_internal/metadata/pkg_resources.py", line 192, in version
return parse_version(self._dist.version)
File "/usr/local/lib/python3.10/site-packages/pip/_vendor/packaging/version.py", line 56, in parse
return Version(version)
File "/usr/local/lib/python3.10/site-packages/pip/_vendor/packaging/version.py", line 202, in init
raise InvalidVersion(f"Invalid version: '{version}'")
pip._vendor.packaging.version.InvalidVersion: Invalid version: '0.1.0-git782048c.abi0.dtk2404.torch2.1.'