Commits · 95965d31b6ac2c9557816a6ffabe4a3117a5ccb2 · OpenDAS / vllm_cscc

18 Sep, 2024 1 commit
- [CI/Build] fix Dockerfile.cpu on podman (#8540) · 95965d31
  Daniele authored Sep 18, 2024
  
  95965d31
11 Sep, 2024 2 commits
- [Hardware][Intel] Support compressed-tensor W8A8 for CPU backend (#7257) · 0b952af4
  Li, Jiang authored Sep 12, 2024
  
  0b952af4
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
15 Aug, 2024 1 commit
- [Misc] Update dockerfile for CPU to cover protobuf installation (#7182) · f4da5f7b
  PHILO-HE authored Aug 16, 2024
  
  f4da5f7b
08 Aug, 2024 1 commit
- [CI/Build] Dockerfile.cpu improvements (#7298) · e9045767
  Daniele authored Aug 08, 2024
  
  e9045767
02 Aug, 2024 1 commit
- [Hardware][Intel CPU] Update torch 2.4.0 for CPU backend (#6931) · c16eaac5
  Jie Fu (傅杰) authored Aug 02, 2024
  
  c16eaac5
26 Jul, 2024 1 commit
- [Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend... · 3bbb4936
  Li, Jiang authored Jul 27, 2024
```
[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation  (#6125)
```
  3bbb4936
04 Jul, 2024 1 commit
- [Hardware][Intel CPU] Adding intel openmp tunings in Docker file (#6008) · 81d7a50f
  Yuan authored Jul 05, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  81d7a50f
17 Jun, 2024 1 commit
- [CI/BUILD] Support non-AVX512 vLLM building and testing (#5574) · ab66536d
  Jie Fu (傅杰) authored Jun 18, 2024
  
  ab66536d
13 Jun, 2024 1 commit
- [Hardware][Intel] Optimize CPU backend and add more performance tips (#4971) · 80aa7e91
  Li, Jiang authored Jun 14, 2024
```
Co-authored-by: Jianan Gu <jianan.gu@intel.com>
```
  80aa7e91
04 Jun, 2024 1 commit
- [Bugfix] Fix a bug caused by pip install setuptools>=49.4.0 for CPU backend (#5249) · 87d5abef
  Jie Fu (傅杰) authored Jun 05, 2024
  
  87d5abef
03 Jun, 2024 1 commit
- [CI/BUILD] enable intel queue for longer CPU tests (#4113) · cafb8e06
  Yuan authored Jun 04, 2024
  
  cafb8e06
23 May, 2024 1 commit
- [Bugfix] Update Dockerfile.cpu to fix NameError: name 'vllm_ops' is not defined (#5009) · 2ba80bed
  Letian Li authored May 23, 2024
  
  2ba80bed
02 Apr, 2024 1 commit

[Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe

bigPYJ1151 authored Apr 02, 2024


Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

0e3f06fe