Commits · f23871e9eead900d6146961ca894f5bc91f30f5e · OpenDAS / vllm_cscc · GitLab

25 Jun, 2024 2 commits
- [Doc] Add notice about breaking changes to VLMs (#5818) · f23871e9
  Cyrus Leung authored Jun 25, 2024
  
  f23871e9
- [ci] Remove aws template (#5757) · e9de9dd5
  Kevin H. Luu authored Jun 24, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  e9de9dd5
24 Jun, 2024 5 commits
- [Bugfix] Fix FlexibleArgumentParser replaces _ with - for actual args (#5795) · ba991d5c
  Chang Su authored Jun 24, 2024
  
  ba991d5c
- [Doc] Add Phi-3-medium to list of supported models (#5788) · 1744cc99
  Michael Goin authored Jun 24, 2024
  
  1744cc99
- [Doc] Add "Suggest edit" button to doc pages (#5789) · e72dc6cb
  Michael Goin authored Jun 24, 2024
  
  e72dc6cb
- [doc][faq] add warning to download models for every nodes (#5783) · c2462129
  youkaichao authored Jun 24, 2024
  
  c2462129
- [Bugfix] Add phi3v resize for dynamic shape and fix torchvision requirement (#5772) · edd5fe5f
  Isotr0py authored Jun 24, 2024
  
  edd5fe5f
23 Jun, 2024 2 commits
- [Distributed] Add send and recv helpers (#5719) · 5d4d9053
  Murali Andoorveedu authored Jun 23, 2024
  
  5d4d9053
- [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) · 6c916ac8
  Varun Sundar Rabindranath authored Jun 24, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  6c916ac8
22 Jun, 2024 6 commits
- [core][distributed] improve shared memory broadcast (#5754) · 832ea88f
  youkaichao authored Jun 22, 2024
  
  832ea88f
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
- [Bugfix] Fix pin_lora error in TPU executor (#5760) · 0cbc1d2b
  Woosuk Kwon authored Jun 21, 2024
  
  0cbc1d2b
- [Misc] Remove #4789 workaround left in vllm/entrypoints/openai/run_batch.py (#5756) · ff9ddbce
  zifeitong authored Jun 21, 2024
  
  ff9ddbce
- [Model] Support Qwen-VL and Qwen-VL-Chat models with text-only inputs (#5710) · 9c62db07
  Jie Fu (傅杰) authored Jun 22, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  9c62db07
- [CI][Hardware][Intel GPU] add Intel GPU(XPU) ci pipeline (#5616) · cf90ae01
  Kunshang Ji authored Jun 22, 2024
  
  cf90ae01
21 Jun, 2024 11 commits
- [LoRA] Add support for pinning lora adapters in the LRU cache (#5603) · f5dda63e
  rohithkrn authored Jun 21, 2024
  
  f5dda63e
- [ci][test] fix ca test in main (#5746) · 71875073
  youkaichao authored Jun 21, 2024
  
  71875073
- [BugFix] exclude version 1.15.0 for modelscope (#5668) · f1e72cc1
  zhyncs authored Jun 22, 2024
  
  f1e72cc1
- [Doc] Documentation on supported hardware for quantization methods (#5745) · 5b15bde5
  Michael Goin authored Jun 21, 2024
  
  5b15bde5
- [Kernel][CPU] Add Quick `gelu` to CPU (#5717) · bd620b01
  Roger Wang authored Jun 20, 2024
  
  bd620b01
- [Core][Distributed] add shm broadcast (#5399) · d9a252bc
  youkaichao authored Jun 20, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d9a252bc
- [Bugfix] Add fully sharded layer for QKVParallelLinearWithLora (#5665) · 67005a07
  Jee Li authored Jun 21, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  67005a07
- [BugFix] Fix test_phi3v.py (#5725) · c35e4a3d
  Chang Su authored Jun 20, 2024
  
  c35e4a3d
- [Kernel] Add punica dimension for Qwen2 LoRA (#5441) · 1f567421
  Jinzhen Lin authored Jun 21, 2024
  
  1f567421
- [Model] MLPSpeculator speculative decoding support (#4947) · b12518d3
  Joshua Rosenkranz authored Jun 20, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>
```
  b12518d3
- [distributed][misc] use fork by default for mp (#5669) · 6c5b7af1
  youkaichao authored Jun 20, 2024
  
  6c5b7af1
20 Jun, 2024 7 commits
- [Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718) · 8065a7e2
  Michael Goin authored Jun 20, 2024
  
  8065a7e2
- [Bugfix] Fix the CUDA version check for FP8 support in the CUTLASS kernels (#5715) · 3f3b6b21
  Tyler Michael Smith authored Jun 20, 2024
  
  3f3b6b21
- [Kernel] Update Cutlass int8 kernel configs for SM80 (#5275) · a7dcc620
  Varun Sundar Rabindranath authored Jun 20, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  a7dcc620
- [Model] Port over CLIPVisionModel for VLMs (#5591) · ad137cd1
  Roger Wang authored Jun 20, 2024
  
  ad137cd1
- [Kernel] Update Cutlass int8 kernel configs for SM90 (#5514) · 111af1fa
  Varun Sundar Rabindranath authored Jun 20, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  111af1fa
- [Bugfix][Doc] FIx Duplicate Explicit Target Name Errors (#5703) · 1b2eaac3
  Roger Wang authored Jun 19, 2024
  
  1b2eaac3
- [Misc] Improve conftest (#5681) · 3730a1c8
  Cyrus Leung authored Jun 20, 2024
  
  3730a1c8
19 Jun, 2024 7 commits
- [ci] Limit num gpus if specified for A100 (#5694) · 949e49a6
  Kevin H. Luu authored Jun 19, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  949e49a6
- [Misc] Add per channel support for static activation quantization; update w8a8... · 4a30d7e3
  Dipika Sikka authored Jun 19, 2024
```
[Misc] Add per channel support for static activation quantization; update w8a8 schemes to share base classes (#5650)
```
  4a30d7e3
- [Doc] Update docker references (#5614) · e83db9e7
  Rafael Vasquez authored Jun 19, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  e83db9e7
- [Bugfix] AsyncLLMEngine hangs with asyncio.run (#5654) · 78687504
  zifeitong authored Jun 19, 2024
  
  78687504
- [ci][distributed] add tests for custom allreduce (#5689) · d571ca01
  youkaichao authored Jun 19, 2024
  
  d571ca01
- [Frontend][Bugfix] Fix preemption_mode -> preemption-mode for CLI arg in arg_utils.py (#5688) · afed90a0
  Michael Goin authored Jun 19, 2024
  
  afed90a0
- [ci] Add A100 queue into AWS CI template (#5648) · 3ee5c4bc
  Kevin H. Luu authored Jun 19, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  3ee5c4bc