Commits · ac3d748dba446b9a8417fe3005345c12989d8de0 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "a4712989db6787e84b26eba334519a424890ca09"

29 Oct, 2024 11 commits
- [Model] Add LlamaEmbeddingModel as an embedding Implementation of LlamaModel (#9806) · ac3d748d
  Junichi Sato authored Oct 30, 2024
  
  ac3d748d
- [Misc]: Typo fix: Renaming classes (casualLM -> causalLM) (#9801) · 0ce7798f
  yannicks1 authored Oct 29, 2024
```
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
```
  0ce7798f
- [Bugfix] Use host argument to bind to interface (#9798) · 0f433871
  Sven Seeberg authored Oct 29, 2024
  
  0f433871
- Fix the log to correct guide user to install modelscope (#9793) · 08600ddc
  tastelikefeet authored Oct 30, 2024
```
Signed-off-by: yuze.zyz <yuze.zyz@alibaba-inc.com>
```
  08600ddc
- [Misc] Add metrics for request queue time, forward time, and execute time (#9659) · 74fc2d77
  科英 authored Oct 30, 2024
  
  74fc2d77
- [Hardware] using current_platform.seed_everything (#9785) · 622b7ab9
  wangshuai09 authored Oct 29, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  622b7ab9
- [Model] Add BNB quantization support for Mllama (#9720) · 09500f7d
  Isotr0py authored Oct 29, 2024
  
  09500f7d
- [Frontend] re-enable multi-modality input in the new beam search implementation (#9427) · ef7865b4
  Zhong Qishuai authored Oct 29, 2024
```
Signed-off-by: Qishuai Ferdinandzhong@gmail.com
```
  ef7865b4
- [Bugfix] Use temporary directory in registry (#9721) · eae3d481
  Cyrus Leung authored Oct 29, 2024
  
  eae3d481
- [Doc] Specify async engine args in docs (#9726) · e74f2d44
  Cyrus Leung authored Oct 29, 2024
  
  e74f2d44
- [Model][LoRA]LoRA support added for Qwen (#9622) · 7a4df5f2
  Jee Jee Li authored Oct 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7a4df5f2
28 Oct, 2024 8 commits
- [torch.compile] add deepseek v2 compile (#9775) · 76ed5340
  youkaichao authored Oct 28, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  76ed5340
- [misc] avoid circular import (#9765) · 97b61bfa
  youkaichao authored Oct 28, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  97b61bfa
- Adding "torch compile" annotations to moe models (#9758) · aa0addb3
  Yongzao authored Oct 29, 2024
  
  aa0addb3
- [Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075
  litianjian authored Oct 29, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f8d8075
- [Bugfix] Fix ray instance detect issue (#9439) · 2adb4409
  Yan Ma authored Oct 28, 2024
  
  2adb4409
- Fix beam search eos (#9627) · feb92fbe
  Robert Shaw authored Oct 28, 2024
  
  feb92fbe
- [torch.compile] support moe models (#9632) · 32176fee
  youkaichao authored Oct 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  32176fee
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
27 Oct, 2024 4 commits
- [Bugfix] Fix load config when using bools (#9533) · 34a99416
  madt2709 authored Oct 27, 2024
  
  34a99416
- [Misc] Upgrade to pytorch 2.5 (#9588) · 3cb07a36
  bnellnm authored Oct 27, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  3cb07a36
- [core] cudagraph output with tensor weak reference (#9724) · 8549c826
  youkaichao authored Oct 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8549c826
- [Misc] SpecDecodeWorker supports profiling (#9719) · 67a6882d
  科英 authored Oct 27, 2024
```
Signed-off-by: Abatom <abatom@163.com>
```
  67a6882d
26 Oct, 2024 5 commits
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
- Fix: MI100 Support By Bypassing Custom Paged Attention (#9560) · 55137e8e
  ErkinSagiroglu authored Oct 26, 2024
  
  55137e8e
- [Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716) · 5cbdccd1
  Mengqing Cao authored Oct 26, 2024
  
  5cbdccd1
- [Bugfix] Steaming continuous_usage_stats default to False (#9709) · 067e77f9
  Sam Stoelinga authored Oct 25, 2024
```
Signed-off-by: Sam Stoelinga <sammiestoel@gmail.com>
```
  067e77f9
25 Oct, 2024 4 commits
- [Bugfix] Fix crash with llama 3.2 vision models and guided decoding (#9631) · 6567e137
  Travis Johnson authored Oct 25, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: pavlo-ruban <pavlo.ruban@servicenow.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  6567e137
- [Bugfix] Fix compressed_tensors_moe bad config.strategy (#9677) · ca0d9222
  Michael Goin authored Oct 25, 2024
  
  ca0d9222
- [V1] Support sliding window attention (#9679) · 9645b9f6
  Woosuk Kwon authored Oct 24, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9645b9f6
- [Model] add a lora module for granite 3.0 MoE models (#9673) · a6f37218
  Will Johnson authored Oct 25, 2024
  
  a6f37218
24 Oct, 2024 8 commits
- [Bugfix] Remove xformers requirement for Pixtral (#9597) · c91ed47c
  Michael Goin authored Oct 24, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  c91ed47c
- [Performance][Kernel] Fused_moe Performance Improvement (#9384) · 59449095
  Charlie Fu authored Oct 24, 2024
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  59449095
- [Log][Bugfix] Fix default value check for `image_url.detail` (#9663) · e26d37a1
  Michael Goin authored Oct 24, 2024
  
  e26d37a1
- [Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650) · 722d46ed
  Alex Brooks authored Oct 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  722d46ed
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653) · f5845496
  litianjian authored Oct 24, 2024
  
  f5845496
- [torch.compile] expanding support and fix allgather compilation (#9637) · ad6f7805
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  ad6f7805
- [Kernel] add kernel for FATReLU (#9610) · 295a061f
  Jee Jee Li authored Oct 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  295a061f