Commits · b40cf6402e356a10415e969e648a32911fb9b8ec · OpenDAS / vllm_cscc

"benchmarks/vscode:/vscode.git/clone" did not exist on "ee56782b981784a8a8d7d788c4775b7a03c5715c"

15 Nov, 2024 4 commits
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
- [bugfix] Fix static asymmetric quantization case (#10334) · bf2ddc66
  Luka Govedič authored Nov 14, 2024
```
Signed-off-by: Daniël de Kok <me@danieldk.eu>
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Daniël de Kok <me@danieldk.eu>
```
  bf2ddc66
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
- [Perf] Reduce peak memory usage of llama (#10339) · b2e0ad3b
  Murali Andoorveedu authored Nov 14, 2024
```
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
```
  b2e0ad3b
14 Nov, 2024 4 commits
- Support Roberta embedding models (#9387) · 4a18fd14
  Maximilien de Bayser authored Nov 14, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  4a18fd14
- [Model] Add BNB quantization support for Idefics3 (#10310) · 294bf467
  B-201 authored Nov 14, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  294bf467
- [misc] error early for old-style class (#10304) · 504ac53d
  youkaichao authored Nov 13, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  504ac53d
- [Bugfix] Fix tensor parallel for qwen2 classification model (#10297) · 15bb8330
  Isotr0py authored Nov 14, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  15bb8330
13 Nov, 2024 6 commits
- [Bugfix] bitsandbytes models fail to run pipeline parallel (#10200) · ac49b59d
  HoangCongDuc authored Nov 14, 2024
```
Signed-off-by: Hoang Cong Duc <hoangcongducltt@gmail.com>
```
  ac49b59d
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [Model][LoRA]LoRA support added for idefics3 (#10281) · d909acf9
  B-201 authored Nov 13, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  d909acf9
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1
- [Model] Add support for Qwen2-VL video embeddings input & multiple image... · 3945c823
  电脑星人 authored Nov 13, 2024
```
[Model] Add support for Qwen2-VL video embeddings input & multiple image embeddings input with varied resolutions (#10221)
Signed-off-by: imkero <kerorek@outlook.com>
```
  3945c823
- [V1] Support VLMs with fine-grained scheduling (#9871) · bbd3e869
  Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  bbd3e869
12 Nov, 2024 3 commits
- [Encoder Decoder] Update Mllama to run with both FlashAttention and XFormers (#9982) · b41fb9d3
  sroy745 authored Nov 12, 2024
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  b41fb9d3
- [Bugfix] Fix QwenModel argument (#10262) · 176fcb1c
  Jie Fu (傅杰) authored Nov 13, 2024
```
Signed-off-by: Jie Fu <jiefu@tencent.com>
```
  176fcb1c
- [Misc]Fix Idefics3Model argument (#10255) · a838ba72
  Jee Jee Li authored Nov 12, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a838ba72
11 Nov, 2024 2 commits
- [Hardware][CPU] Add embedding models support for CPU backend (#10193) · 58170d65
  Isotr0py authored Nov 11, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  58170d65
- [6/N] pass whole config to inner model (#10205) · f89d18ff
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f89d18ff
09 Nov, 2024 6 commits
- [CI/Build] Split up models tests (#10069) · 51c2e1fc
  Cyrus Leung authored Nov 10, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51c2e1fc
- [bugfix] fix broken tests of mlp speculator (#10177) · bd46357a
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bd46357a
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
- [Bugfix] Ignore GPTQ quantization of Qwen2-VL visual module (#10169) · f83feccd
  Michael Goin authored Nov 08, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  f83feccd
- [0/N] Rename `MultiModalInputs` to `MultiModalKwargs` (#10040) · e0191a95
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e0191a95
- [Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8... · 127c0748
  rasmith authored Nov 08, 2024
```
[Kernel][Triton] Add Triton implementation for scaled_mm_triton to support fp8 and int8 SmoothQuant, symmetric case (#9857)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  127c0748
08 Nov, 2024 2 commits
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
- [Model] Expose size to Idefics3 as mm_processor_kwargs (#10146) · 1ff4aed5
  Isotr0py authored Nov 08, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1ff4aed5
07 Nov, 2024 5 commits
- Online video support for VLMs (#10020) · 28b2877d
  litianjian authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  28b2877d
- [Bugfix] Make image processor respect `mm_processor_kwargs` for Qwen2-VL (#10112) · 999df95b
  Jiahao Li authored Nov 07, 2024
```
Signed-off-by: Jiahao Li <liplus17@163.com>
```
  999df95b
- Adds method to read the pooling types from model's files (#9506) · aa9078fa
  Flávia Béo authored Nov 07, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  aa9078fa
- [Hardware][CPU] Update torch 2.5 (#9911) · a4b3e0c1
  Li, Jiang authored Nov 07, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a4b3e0c1
- [Bugfix] Fix FP8 torch._scaled_mm fallback for torch>2.5 with CUDA<12.4 (#10095) · 4ab32566
  Michael Goin authored Nov 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  4ab32566
06 Nov, 2024 8 commits

[V1] Make v1 more testable (#9888) · d58268c5
Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
d58268c5
Remove ScaledActivation for AWQ (#10057) · 399c7986
Michael Goin authored Nov 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
399c7986
[Model][LoRA]LoRA support added for Qwen2VLForConditionalGeneration (#10022) · 406d4cc4
Eric authored Nov 06, 2024
```
Signed-off-by: ericperfect <ericperfectttt@gmail.com>
```
406d4cc4

[Model] Add Idefics3 support (#9767) · a5bba7d2

Jee Jee Li authored Nov 06, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>

a5bba7d2

[Model][LoRA]LoRA support added for LlamaEmbeddingModel (#10071) · 2003cc35
Jee Jee Li authored Nov 06, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
2003cc35

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143) · a02a50e6

Konrad Zawora authored Nov 06, 2024


Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Signed-off-by: Bob Zhu <bob.zhu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
Co-authored-by: Michal Adamczyk <madamczyk@habana.ai>
Co-authored-by: Marceli Fylcek <mfylcek@habana.ai>
Co-authored-by: Himangshu Lahkar <49579433+hlahkar@users.noreply.github.com>
Co-authored-by: Vivek Goel <vgoel@habana.ai>
Co-authored-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Dominika Olszewska <dolszewska@habana.ai>
Co-authored-by: barak goldberg <149692267+bgoldberg-habana@users.noreply.github.com>
Co-authored-by: Michal Szutenberg <37601244+szutenberg@users.noreply.github.com>
Co-authored-by: Jan Kaniecki <jkaniecki@habana.ai>
Co-authored-by: Agata Dobrzyniewicz <160237065+adobrzyniewicz-habana@users.noreply.github.com>
Co-authored-by: Krzysztof Wisniewski <kwisniewski@habana.ai>
Co-authored-by: Dudi Lester <160421192+dudilester@users.noreply.github.com>
Co-authored-by: Ilia Taraban <tarabanil@gmail.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Michał Kuligowski <mkuligowski@habana.ai>
Co-authored-by: Jakub Maksymczuk <jmaksymczuk@habana.ai>
Co-authored-by: Tomasz Zielinski <85164140+tzielinski-habana@users.noreply.github.com>
Co-authored-by: Sun Choi <schoi@habana.ai>
Co-authored-by: Iryna Boiko <iboiko@habana.ai>
Co-authored-by: Bob Zhu <41610754+czhu15@users.noreply.github.com>
Co-authored-by: hlin99 <73271530+hlin99@users.noreply.github.com>
Co-authored-by: Zehao Huang <zehao.huang@intel.com>
Co-authored-by: Andrzej Kotłowski <Andrzej.Kotlowski@intel.com>
Co-authored-by: Yan Tomsinsky <73292515+Yantom1@users.noreply.github.com>
Co-authored-by: Nir David <ndavid@habana.ai>
Co-authored-by: Yu-Zhou <yu.zhou@intel.com>
Co-authored-by: Ruheena Suhani Shaik <rsshaik@habana.ai>
Co-authored-by: Karol Damaszke <kdamaszke@habana.ai>
Co-authored-by: Marcin Swiniarski <mswiniarski@habana.ai>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Jacek Czaja <jacek.czaja@intel.com>
Co-authored-by: Jacek Czaja <jczaja@habana.ai>
Co-authored-by: Yuan <yuan.zhou@outlook.com>

a02a50e6

[CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
21063c11

[Bugfix] Gpt-j-6B patch kv_scale to k_scale path (#10063) · ea928f60

arakowsk-amd authored Nov 05, 2024


Signed-off-by: Alex Rakowski <alex.rakowski@amd.com>
Signed-off-by: Alex Rakowski <182798202+arakowsk-amd@users.noreply.github.com>

ea928f60