Commits · 6650e6a930dbdf1cd4def9b58e952376400ccfcf · OpenDAS / vllm_cscc · GitLab

26 Oct, 2024 3 commits
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
- [Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716) · 5cbdccd1
  Mengqing Cao authored Oct 26, 2024
  
  5cbdccd1
25 Oct, 2024 1 commit
- [ci/Build] Skip Chameleon for transformers 4.46.0 on broadcast test #9675 (#9676) · 9f7b4ba8
  Kevin H. Luu authored Oct 24, 2024
  
  9f7b4ba8
24 Oct, 2024 9 commits
- [Performance][Kernel] Fused_moe Performance Improvement (#9384) · 59449095
  Charlie Fu authored Oct 24, 2024
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  59449095
- [Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650) · 722d46ed
  Alex Brooks authored Oct 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  722d46ed
- [CI/Build] Fix VLM test failures when using transformers v4.46 (#9666) · c866e007
  Cyrus Leung authored Oct 25, 2024
  
  c866e007
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [Kernel] add kernel for FATReLU (#9610) · 295a061f
  Jee Jee Li authored Oct 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  295a061f
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [core] simplify seq group code (#9569) · 4fdc581f
  youkaichao authored Oct 24, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  4fdc581f
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
- [Bugfix]: Make chat content text allow type content (#9358) · 33bab410
  Vinay R Damodaran authored Oct 24, 2024
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
```
  33bab410
23 Oct, 2024 5 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [Frontend] Enable Online Multi-image Support for MLlama (#9393) · 150b7790
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  150b7790
- [Model] Add min_pixels / max_pixels to Qwen2VL as mm_processor_kwargs (#9612) · 31a08f5b
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  31a08f5b
- [Model] Initialize Florence-2 language backbone support (#9555) · 3ff57ebf
  Isotr0py authored Oct 23, 2024
  
  3ff57ebf
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 10 commits
- [BugFix] Fix metrics error for --num-scheduler-steps > 1 (#8234) · b17046e2
  yulei authored Oct 23, 2024
  
  b17046e2
- [BugFix] Prevent exporting duplicate OpenTelemetry spans (#9017) · cd5601ac
  Ronen Schaffer authored Oct 22, 2024
  
  cd5601ac
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
- [CI/Build][LoRA] Temporarily fix long context failure issue (#9579) · a48e3ec0
  Jee Jee Li authored Oct 22, 2024
  
  a48e3ec0
- [Hardware][CPU] using current_platform.is_cpu (#9536) · 3ddbe255
  wangshuai09 authored Oct 22, 2024
  
  3ddbe255
- [CI/Build] Replaced some models on tests for smaller ones (#9570) · c0292211
  Wallas Henrique authored Oct 22, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  c0292211
- [CI/Build] Remove unnecessary `fork_new_process` (#9484) · f085995a
  Cyrus Leung authored Oct 22, 2024
  
  f085995a
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
- [core] move parallel sampling out from vllm core (#9302) · 76a5e132
  youkaichao authored Oct 21, 2024
  
  76a5e132
- 🐛 Fixup more test failures from memory profiling (#9563) · ef7faad1
  Joe Runde authored Oct 21, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  ef7faad1
21 Oct, 2024 3 commits
- [Frontend] Don't log duplicate error stacktrace for every request in the batch (#9023) · 711f3a78
  Wallas Henrique authored Oct 21, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  711f3a78
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
- [CI/Build] Split up decoder-only LM tests (#9488) · 696b01af
  Cyrus Leung authored Oct 21, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  696b01af
20 Oct, 2024 2 commits
- [Kernel] Support sliding window in flash attention backend (#9403) · 4fa3e333
  Chen Zhang authored Oct 20, 2024
  
  4fa3e333
- [Bugfix] Pass json-schema to GuidedDecodingParams and make test stronger (#9530) · 5b59fe0f
  Chen Zhang authored Oct 19, 2024
  
  5b59fe0f
19 Oct, 2024 3 commits
- [Frontend] Support simpler image input format (#9478) · c5eea3c8
  Yue Zhang authored Oct 18, 2024
  
  c5eea3c8
- 🐛 fix torch memory profiling (#9516) · 380e1863
  Joe Runde authored Oct 18, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  380e1863
- [Bugfix] Fix offline mode when using `mistral_common` (#9457) · 337ed766
  sasha0552 authored Oct 19, 2024
  
  337ed766
18 Oct, 2024 4 commits
- [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) · d11bf435
  Cody Yu authored Oct 18, 2024
  
  d11bf435
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
- [Frontend][Feature] Add jamba tool parser (#9154) · d2b1bf55
  tomeras91 authored Oct 18, 2024
  
  d2b1bf55
- [Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352) · de4008e2
  Joe Runde authored Oct 17, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  de4008e2