Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • T text-generation-inference
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Metrics
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • CI/CD
    • Repository
    • Value stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • OpenDAS
  • text-generation-inference
  • Issues
  • #3

Closed
Open
Created Aug 31, 2024 by ncic_liuyao@ncic_liuyao

tgi用哪个版本的pytorch镜像能安装成功

能否给个具体安装镜像版本的说明,我用k100安装,用dtk23.10.1,dtk24.04,dtk24.04.1,安装定制版vllm或最终安装tgi时,都会有报错

24.04.1和23.10.1,都是卡在 make install-vllm
File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1777, in _write_ninja_file_and_compile_objects _run_ninja_build( File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2119, in _run_ninja_build raise RuntimeError(message) from e RuntimeError: Error compiling objects for extension make: *** [Makefile:9: install-vllm] Error 1

这是24.04最后一步安装tgi的报错
WARNING: Error parsing dependencies of lmdeploy: Invalid version: '0.1.0-git782048c.abi0.dtk2404.torch2.1.' WARNING: Error parsing dependencies of mmcv: Invalid version: '2.0.1-gitc0ccf15.abi0.dtk2404.torch2.1.' ERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 105, in _run_wrapper status = _inner_run() File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 96, in _inner_run return self.run(options, args) File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 67, in wrapper return func(self, options, args) File "/usr/local/lib/python3.10/site-packages/pip/_internal/commands/install.py", line 483, in run installed_versions[distribution.canonical_name] = distribution.version File "/usr/local/lib/python3.10/site-packages/pip/_internal/metadata/pkg_resources.py", line 192, in version return parse_version(self._dist.version) File "/usr/local/lib/python3.10/site-packages/pip/_vendor/packaging/version.py", line 56, in parse return Version(version) File "/usr/local/lib/python3.10/site-packages/pip/_vendor/packaging/version.py", line 202, in init raise InvalidVersion(f"Invalid version: '{version}'") pip._vendor.packaging.version.InvalidVersion: Invalid version: '0.1.0-git782048c.abi0.dtk2404.torch2.1.'

Assignee
Assign to
Time tracking