Commits · 8baf85e4e9355611532e361a5cd4d458bc8fe1fe · OpenDAS / vllm_cscc

11 Oct, 2024 1 commit
- [Doc] Compatibility matrix for mutual exclusive features (#8512) · 8baf85e4
  Wallas Henrique authored Oct 11, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  8baf85e4
08 Oct, 2024 2 commits
- [Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) · a3691b6b
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  a3691b6b
- [Frontend] API support for beam search for MQLLMEngine (#9117) · 8c746226
  Brendan Wong authored Oct 07, 2024
  
  8c746226
07 Oct, 2024 2 commits
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
06 Oct, 2024 1 commit
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
05 Oct, 2024 1 commit
- [Bugfix] Fix order of arguments matters in config.yaml (#8960) · 5df18348
  Andy Dai authored Oct 05, 2024
  
  5df18348
29 Sep, 2024 2 commits
- [CI/Build] Add test decorator for minimum GPU memory (#8925) · 26a68d5d
  Cyrus Leung authored Sep 29, 2024
  
  26a68d5d
- [Core] Improve choice of Python multiprocessing method (#8823) · d1537039
  Russell Bryant authored Sep 28, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  d1537039
26 Sep, 2024 1 commit
- [Bugfix] Fix print_warning_once's line info (#8867) · e2f6f26e
  Tyler Michael Smith authored Sep 26, 2024
  
  e2f6f26e
23 Sep, 2024 2 commits
- [Core] Allow IPv6 in VLLM_HOST_IP with zmq (#8575) · b05f5c92
  Russell Bryant authored Sep 23, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b05f5c92
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
22 Sep, 2024 1 commit
- [MISC] rename CudaMemoryProfiler to DeviceMemoryProfiler (#8703) · ca2b628b
  Huazhong Ji authored Sep 23, 2024
  
  ca2b628b
21 Sep, 2024 1 commit
- [MISC] add support custom_op check (#8557) · d4bf085a
  Kunshang Ji authored Sep 21, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  d4bf085a
18 Sep, 2024 1 commit
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
17 Sep, 2024 2 commits
- [Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631) · 1009e93c
  sroy745 authored Sep 17, 2024
  
  1009e93c
- [refactor] remove triton based sampler (#8524) · 546034b4
  Simon Mo authored Sep 16, 2024
  
  546034b4
16 Sep, 2024 1 commit
- [BugFix] Fix clean shutdown issues (#8492) · acd5511b
  Nick Hill authored Sep 16, 2024
  
  acd5511b
12 Sep, 2024 1 commit
- [Misc] Raise error when using encoder/decoder model with cpu backend (#8355) · 295c4730
  Kevin Lin authored Sep 12, 2024
  
  295c4730
06 Sep, 2024 1 commit
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
30 Aug, 2024 1 commit

[Frontend]-config-cli-args (#7737) · 058344f8

Kaunil Dhruv authored Aug 30, 2024


Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>

058344f8

28 Aug, 2024 1 commit

[Bugfix] Allow ScalarType to be compiled with pytorch 2.3 and add checks for... · c166e7e4

bnellnm authored Aug 27, 2024

[Bugfix] Allow ScalarType to be compiled with pytorch 2.3 and add checks for registering FakeScalarType and dynamo support. (#7886)

c166e7e4

21 Aug, 2024 1 commit
- [ci] try to log process using the port to debug the port usage (#7711) · b74a1258
  youkaichao authored Aug 20, 2024
  
  b74a1258
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
13 Aug, 2024 3 commits
- [TPU] Suppress import custom_ops warning (#7458) · d6e634f3
  Woosuk Kwon authored Aug 13, 2024
  
  d6e634f3
- [hardware] unify usage of is_tpu to current_platform.is_tpu() (#7102) · 4d2dc507
  youkaichao authored Aug 13, 2024
  
  4d2dc507
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
12 Aug, 2024 2 commits
- [Bugfix] Handle PackageNotFoundError when checking for xpu version (#7398) · 91294d56
  sasha0552 authored Aug 12, 2024
  
  91294d56
- [Core] Consolidate `GB` constant and enable float GB arguments (#7416) · 4ddc4743
  Cyrus Leung authored Aug 13, 2024
  
  4ddc4743
09 Aug, 2024 2 commits
- [Performance] Optimize e2e overheads: Reduce python allocations (#7162) · e02ac556
  Alexander Matveev authored Aug 09, 2024
  
  e02ac556
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
07 Aug, 2024 4 commits
- [FrontEnd] Make `merge_async_iterators` `is_cancelled` arg optional (#7282) · fc1493a0
  Nick Hill authored Aug 07, 2024
  
  fc1493a0
- [ BugFix ] Move `zmq` frontend to IPC instead of TCP (#7222) · 56498572
  Robert Shaw authored Aug 07, 2024
  
  56498572
- [distributed][misc] add specialized method for cuda platform (#7249) · 639159b2
  youkaichao authored Aug 07, 2024
  
  639159b2
- [BugFix] Overhaul async request cancellation (#7111) · 9a3f49ae
  Nick Hill authored Aug 06, 2024
  
  9a3f49ae
06 Aug, 2024 1 commit

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

03 Aug, 2024 1 commit

[ Frontend ] Multiprocessing for OpenAI Server with `zeromq` (#6883) · ed812a73

Robert Shaw authored Aug 02, 2024


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

ed812a73

02 Aug, 2024 2 commits
- [cuda][misc] remove error_on_invalid_device_count_status (#7069) · 660dea12
  youkaichao authored Aug 02, 2024
  
  660dea12
- [ci][distributed] try to fix pp test (#7054) · 25235779
  youkaichao authored Aug 01, 2024
  
  25235779
31 Jul, 2024 1 commit
- [Bugfix] Fix broadcasting logic for `multi_modal_kwargs` (#6836) · f230cc2c
  Cyrus Leung authored Jul 31, 2024
  
  f230cc2c