Commits · fcfc474d449af116f217d4aa2dbd9cea37fa3e55 · OpenDAS / vllm_cscc

04 Apr, 2025 1 commit
- [CI] Reorganize .buildkite directory (#16001) · 4dc52e1c
  Kevin H. Luu authored Apr 04, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  4dc52e1c
31 Mar, 2025 1 commit
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
28 Mar, 2025 1 commit
- [CPU][CI] Improve CPU Dockerfile (#15690) · 280d0741
  Li, Jiang authored Mar 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  280d0741
25 Mar, 2025 1 commit
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

08 Mar, 2025 1 commit
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
20 Feb, 2025 1 commit
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
17 Jan, 2025 1 commit
- [CI/Build][CPU][Bugfix] Fix CPU CI (#12150) · d4e61945
  Li, Jiang authored Jan 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  d4e61945
12 Jan, 2025 1 commit

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735

Akshat Tripathi authored Jan 12, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

8bddb735

10 Jan, 2025 2 commits
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
08 Jan, 2025 2 commits
- [CI/Build][Bugfix] Fix CPU CI image clean up (#11836) · 2f702498
  Li, Jiang authored Jan 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  2f702498
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
07 Jan, 2025 1 commit
- [CI][CPU] adding build number to docker image name (#11788) · 1e4ce295
  Yuan authored Jan 07, 2025
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  1e4ce295
20 Nov, 2024 1 commit
- [Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355) · 63f1fde2
  Li, Jiang authored Nov 20, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  63f1fde2
19 Nov, 2024 1 commit
- [CI][CPU] adding numa node number as container name suffix (#10441) · b4614656
  Yuan authored Nov 19, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  b4614656
15 Nov, 2024 1 commit
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
14 Nov, 2024 2 commits
- [CI/Build] Make shellcheck happy (#10285) · 675d6034
  Cyrus Leung authored Nov 14, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  675d6034
- [CI/Build] Fix CPU CI online inference timeout (#10314) · 03025c02
  Isotr0py authored Nov 14, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  03025c02
12 Nov, 2024 1 commit
- [CI][CPU]refactor CPU tests to allow to bind with different cores (#10222) · d201d419
  Yuan authored Nov 12, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  d201d419
11 Nov, 2024 2 commits
- [Bugfix][Hardware][CPU] Fix broken encoder-decoder CPU runner (#10218) · 2cebda42
  Isotr0py authored Nov 11, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2cebda42
- [Hardware][CPU] Add embedding models support for CPU backend (#10193) · 58170d65
  Isotr0py authored Nov 11, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  58170d65
09 Nov, 2024 1 commit
- [CI/Build] Adding timeout in CPU CI to avoid CPU test queue blocking (#6892) · d7edca1d
  Li, Jiang authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7edca1d
08 Nov, 2024 1 commit
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
07 Nov, 2024 2 commits
- [CI/Build] Add shell script linting using shellcheck (#7925) · 3be5b26a
  Russell Bryant authored Nov 07, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3be5b26a
- [Hardware][CPU] Update torch 2.5 (#9911) · a4b3e0c1
  Li, Jiang authored Nov 07, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a4b3e0c1
17 Oct, 2024 1 commit
- [Hardware][CPU] compressed-tensor INT8 W8A8 AZP support (#9344) · 5eda21e7
  Li, Jiang authored Oct 18, 2024
  
  5eda21e7
11 Oct, 2024 1 commit
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
09 Oct, 2024 1 commit
- [Hardware][CPU] Support AWQ for CPU backend (#7515) · ca77dd7a
  Li, Jiang authored Oct 10, 2024
  
  ca77dd7a
07 Oct, 2024 1 commit
- [Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend (#9089) · 4f95ffee
  Isotr0py authored Oct 07, 2024
  
  4f95ffee
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 1 commit
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
11 Sep, 2024 1 commit
- [Hardware][Intel] Support compressed-tensor W8A8 for CPU backend (#7257) · 0b952af4
  Li, Jiang authored Sep 12, 2024
  
  0b952af4
04 Sep, 2024 1 commit
- [MISC] Consolidate FP8 kv-cache tests (#8131) · 2ad2e560
  Cody Yu authored Sep 04, 2024
  
  2ad2e560
18 Aug, 2024 1 commit
- [CI/Build] Add text-only test for Qwen models (#7475) · 40e1360b
  Alex Brooks authored Aug 18, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  40e1360b
15 Aug, 2024 1 commit
- [Misc] Update dockerfile for CPU to cover protobuf installation (#7182) · f4da5f7b
  PHILO-HE authored Aug 16, 2024
  
  f4da5f7b
14 Aug, 2024 1 commit
- [misc][ci] fix cpu test with plugins (#7489) · ea49e6a3
  youkaichao authored Aug 13, 2024
  
  ea49e6a3
27 Jul, 2024 1 commit
- [Model] H2O Danube3-4b (#6451) · 14dbd5a7
  Joe authored Jul 26, 2024
  
  14dbd5a7
26 Jul, 2024 1 commit
- [Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend... · 3bbb4936
  Li, Jiang authored Jul 27, 2024
```
[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation  (#6125)
```
  3bbb4936
04 Jul, 2024 1 commit
- [Hardware][Intel CPU] Adding intel openmp tunings in Docker file (#6008) · 81d7a50f
  Yuan authored Jul 05, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
```
  81d7a50f