Commits · 395b1c74543053ebf25d4ab3af828cd145506caa · OpenDAS / vllm_cscc · GitLab

27 Nov, 2024 1 commit
- [Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635) · 395b1c74
  tomeras91 authored Nov 27, 2024
```
Signed-off-by: Tomer Asida <tomera@ai21.com>
```
  395b1c74
26 Nov, 2024 1 commit
- [misc] do not read HOST_IP (#10644) · 6e9ff050
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6e9ff050
23 Nov, 2024 1 commit
- [2/N] handling placeholders in merged multi-modal processor (#10485) · c8acd805
  Cyrus Leung authored Nov 23, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c8acd805
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
21 Nov, 2024 3 commits
- [8/N] enable cli flag without a space (#10529) · 7560ae5c
  youkaichao authored Nov 21, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  7560ae5c
- [Misc] Suppress duplicated logging regarding multimodal input pipeline (#10530) · c51e397f
  Roger Wang authored Nov 21, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c51e397f
- [torch.compile] Inductor code caching fix (#10273) · 8b0fe06c
  Luka Govedič authored Nov 21, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
```
  8b0fe06c
20 Nov, 2024 1 commit
- [Misc] Add __setitem__ for LazyDict (#10469) · 9e05252b
  Yanyi Liu authored Nov 20, 2024
```
Signed-off-by: Yanyi Liu <wolfsonliu@163.com>
```
  9e05252b
18 Nov, 2024 1 commit
- [4/N][torch.compile] clean up set_torch_compile_backend (#10401) · 51bb12d1
  youkaichao authored Nov 17, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51bb12d1
15 Nov, 2024 1 commit
- [Misc] Fix import error in tensorizer tests and cleanup some code (#10349) · b311efd0
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b311efd0
10 Nov, 2024 1 commit

[Misc] small fixes to function tracing file path (#9543) · 20cf2f55

Shawn Du authored Nov 11, 2024


Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

20cf2f55

07 Nov, 2024 1 commit
- [Misc] Consolidate ModelConfig code related to HF config (#10104) · db7db4aa
  Cyrus Leung authored Nov 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db7db4aa
06 Nov, 2024 2 commits

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143) · a02a50e6

Konrad Zawora authored Nov 06, 2024


Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Signed-off-by: Bob Zhu <bob.zhu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
Co-authored-by: Michal Adamczyk <madamczyk@habana.ai>
Co-authored-by: Marceli Fylcek <mfylcek@habana.ai>
Co-authored-by: Himangshu Lahkar <49579433+hlahkar@users.noreply.github.com>
Co-authored-by: Vivek Goel <vgoel@habana.ai>
Co-authored-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Dominika Olszewska <dolszewska@habana.ai>
Co-authored-by: barak goldberg <149692267+bgoldberg-habana@users.noreply.github.com>
Co-authored-by: Michal Szutenberg <37601244+szutenberg@users.noreply.github.com>
Co-authored-by: Jan Kaniecki <jkaniecki@habana.ai>
Co-authored-by: Agata Dobrzynie...

a02a50e6

[CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
21063c11

05 Nov, 2024 1 commit
- [Misc] vllm CLI flags should be ordered for better user readability (#10017) · 93dee88f
  Chauncey authored Nov 05, 2024
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  93dee88f
02 Nov, 2024 2 commits
- [torch.compile] fix cpu broken code (#9947) · af7380d8
  youkaichao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  af7380d8
- [Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559) · a78dd330
  sroy745 authored Nov 01, 2024
  
  a78dd330
01 Nov, 2024 1 commit
- [torch.compile] directly register custom op (#9896) · 96e0c9cb
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96e0c9cb
30 Oct, 2024 2 commits
- [CI/Build] VLM Test Consolidation (#9372) · cc98f1e0
  Alex Brooks authored Oct 30, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  cc98f1e0
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
29 Oct, 2024 1 commit
- [Hardware] using current_platform.seed_everything (#9785) · 622b7ab9
  wangshuai09 authored Oct 29, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  622b7ab9
28 Oct, 2024 1 commit
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
27 Oct, 2024 2 commits
- [Bugfix] Fix load config when using bools (#9533) · 34a99416
  madt2709 authored Oct 27, 2024
  
  34a99416
- [core] cudagraph output with tensor weak reference (#9724) · 8549c826
  youkaichao authored Oct 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8549c826
26 Oct, 2024 1 commit
- [Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716) · 5cbdccd1
  Mengqing Cao authored Oct 26, 2024
  
  5cbdccd1
23 Oct, 2024 1 commit
- [Hardware][XPU] using current_platform.is_xpu (#9605) · 2394962d
  Mengqing Cao authored Oct 23, 2024
  
  2394962d
22 Oct, 2024 3 commits
- [Neuron] [Bugfix] Fix neuron startup (#9374) · 9dbcce84
  xendo authored Oct 22, 2024
```
Co-authored-by: Jerzy Zagorski <jzagorsk@amazon.com>
```
  9dbcce84
- [Hardware][CPU] using current_platform.is_cpu (#9536) · 3ddbe255
  wangshuai09 authored Oct 22, 2024
  
  3ddbe255
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
21 Oct, 2024 1 commit
- [Frontend] Reduce frequency of client cancellation checking (#7959) · 9d9186be
  Nick Hill authored Oct 21, 2024
  
  9d9186be
18 Oct, 2024 1 commit
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
17 Oct, 2024 1 commit
- [torch.compile] Fine-grained CustomOp enabling mechanism (#9300) · 0f41fbe5
  Luka Govedič authored Oct 17, 2024
  
  0f41fbe5
11 Oct, 2024 1 commit
- [Doc] Compatibility matrix for mutual exclusive features (#8512) · 8baf85e4
  Wallas Henrique authored Oct 11, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  8baf85e4
08 Oct, 2024 2 commits
- [Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) · a3691b6b
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  a3691b6b
- [Frontend] API support for beam search for MQLLMEngine (#9117) · 8c746226
  Brendan Wong authored Oct 07, 2024
  
  8c746226
07 Oct, 2024 2 commits
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
06 Oct, 2024 1 commit
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
05 Oct, 2024 1 commit
- [Bugfix] Fix order of arguments matters in config.yaml (#8960) · 5df18348
  Andy Dai authored Oct 05, 2024
  
  5df18348
29 Sep, 2024 1 commit
- [CI/Build] Add test decorator for minimum GPU memory (#8925) · 26a68d5d
  Cyrus Leung authored Sep 29, 2024
  
  26a68d5d