Commits · 214efc2c3cb568e8eb3f7d234f3bd8f5bbe24795 · OpenDAS / vllm_cscc

25 Nov, 2024 1 commit

Support Cross encoder models (#10400) · 214efc2c

Maximilien de Bayser authored Nov 24, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

214efc2c

20 Nov, 2024 1 commit
- [Bugfix] Handle conflicts between modern and legacy fields (#10471) · 09dbf9ff
  Cyrus Leung authored Nov 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dbf9ff
15 Nov, 2024 2 commits
- [Bugfix] Ensure special tokens are properly filtered out for guided structured... · 691a3ec0
  Guillaume Calmettes authored Nov 15, 2024
```
[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  691a3ec0
- [Tool parsing] Improve / correct mistral tool parsing (#10333) · 11cd1ae6
  Patrick von Platen authored Nov 15, 2024
  
  11cd1ae6
11 Nov, 2024 1 commit
- [misc] improve cloudpickle registration and tests (#10202) · 73b9083e
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  73b9083e
09 Nov, 2024 1 commit

[Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6

Krishna Mandal authored Nov 09, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

b09895a6

08 Nov, 2024 1 commit
- Fix edge case Mistral tokenizer (#10152) · 0535e5fe
  Patrick von Platen authored Nov 08, 2024
  
  0535e5fe
07 Nov, 2024 2 commits
- Adds method to read the pooling types from model's files (#9506) · aa9078fa
  Flávia Béo authored Nov 07, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  aa9078fa
- [Misc] Consolidate ModelConfig code related to HF config (#10104) · db7db4aa
  Cyrus Leung authored Nov 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db7db4aa
06 Nov, 2024 2 commits
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
- [Bugfix] Fix edge-case crash when using chat with the Mistral Tekken Tokenizer (#10051) · 2bcbae70
  Travis Johnson authored Nov 05, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  2bcbae70
04 Nov, 2024 1 commit

[Model] Add support for H2OVL-Mississippi models (#9747) · 54597724

shanshan wang authored Nov 03, 2024


Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

54597724

01 Nov, 2024 1 commit

[Bugfix] Fix edge cases for MistralTokenizer (#9625) · 1dd4cb29

Travis Johnson authored Nov 01, 2024


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

1dd4cb29

29 Oct, 2024 2 commits
- [Bugfix][Frontend] Guard against bad token ids (#9634) · 67bdf8e5
  Joe Runde authored Oct 29, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  67bdf8e5
- Fix the log to correct guide user to install modelscope (#9793) · 08600ddc
  tastelikefeet authored Oct 30, 2024
```
Signed-off-by: yuze.zyz <yuze.zyz@alibaba-inc.com>
```
  08600ddc
22 Oct, 2024 3 commits
- [Bugfix] fix detokenizer shallow copy (#5919) · 23b899a8
  Aurick Qiao authored Oct 22, 2024
  
  23b899a8
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
19 Oct, 2024 1 commit
- [Bugfix] Fix offline mode when using `mistral_common` (#9457) · 337ed766
  sasha0552 authored Oct 19, 2024
  
  337ed766
18 Oct, 2024 2 commits
- [Model] Support Pixtral models in the HF Transformers format (#9036) · 3921a2f2
  Michael Goin authored Oct 18, 2024
  
  3921a2f2
- [CI/Build] Fix lint errors in mistral tokenizer (#9504) · 1bbbcc0b
  Cyrus Leung authored Oct 19, 2024
  
  1bbbcc0b
17 Oct, 2024 1 commit
- [Bugfix] Allow prefill of assistant response when using `mistral_common` (#9446) · 5e443b59
  sasha0552 authored Oct 17, 2024
  
  5e443b59
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
12 Oct, 2024 1 commit
- [bugfix] fix f-string for error (#9295) · d11b46f3
  Prashant Gupta authored Oct 11, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  d11b46f3
11 Oct, 2024 1 commit
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
07 Oct, 2024 1 commit
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
05 Oct, 2024 1 commit
- [Bugfix] Deprecate registration of custom configs to huggingface (#9083) · cfadb9c6
  Chen Zhang authored Oct 05, 2024
  
  cfadb9c6
28 Sep, 2024 2 commits
- [Bugfix] Fix code for downloading models from modelscope (#8443) · 39d3f8d9
  tastelikefeet authored Sep 28, 2024
  
  39d3f8d9
- [Misc] Remove vLLM patch of `BaichuanTokenizer` (#8921) · b0298aa8
  Cyrus Leung authored Sep 28, 2024
  
  b0298aa8
26 Sep, 2024 2 commits
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 2 commits

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding (#8047) · 01b6f9e1
Travis Johnson authored Sep 24, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
01b6f9e1

23 Sep, 2024 1 commit
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
20 Sep, 2024 1 commit
- [Bugfix][Core] Fix tekken edge case for mistral tokenizer (#8640) · b4e4eda9
  Patrick von Platen authored Sep 20, 2024
  
  b4e4eda9
18 Sep, 2024 1 commit
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
17 Sep, 2024 1 commit
- [Model] Add mistral function calling format to all models loaded with "mistral" format (#8515) · a54ed802
  Patrick von Platen authored Sep 17, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a54ed802
12 Sep, 2024 2 commits
- [Bugfix] Offline mode fix (#8376) · f2e263b8
  Joe Runde authored Sep 12, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  f2e263b8
- [Hotfix][VLM] Fixing max position embeddings for Pixtral (#8399) · 520ca380
  Roger Wang authored Sep 12, 2024
  
  520ca380
11 Sep, 2024 1 commit
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e