Commits · 96ae75ad7f96c70c436f9297b06d059ad85140f9 · OpenDAS / vllm_cscc

26 Dec, 2024 1 commit
- [Misc] Add placeholder module (#11501) · eec906d8
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eec906d8
20 Dec, 2024 1 commit
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623
19 Dec, 2024 1 commit
- [Misc] Clean up and consolidate LRUCache (#11339) · cdf22afd
  Cyrus Leung authored Dec 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cdf22afd
18 Dec, 2024 1 commit
- [Bugfix] Fix guided decoding with tokenizer mode mistral (#11046) · 8b79f9e1
  Wallas Henrique authored Dec 18, 2024
  
  8b79f9e1
10 Dec, 2024 1 commit
- [BUG] Remove token param #10921 (#11022) · 250ee65d
  Flávia Béo authored Dec 10, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
```
  250ee65d
04 Dec, 2024 1 commit
- [LoRA] Change lora_tokenizers capacity (#10796) · 01d079fd
  Xin Yang authored Dec 04, 2024
```
Signed-off-by: Xin Yang <xyang19@gmail.com>
```
  01d079fd
27 Nov, 2024 1 commit

[Model] Support telechat2 (#10311) · 1209261e

shunxing12345 authored Nov 27, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>

1209261e

25 Nov, 2024 3 commits

[Model] Add OLMo November 2024 model (#10503) · 9db713a1
Shane A authored Nov 25, 2024

9db713a1

[Model]: Add support for Aria model (#10514) · b1d92053

zhou fan authored Nov 26, 2024


Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

b1d92053

Support Cross encoder models (#10400) · 214efc2c

Maximilien de Bayser authored Nov 24, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

214efc2c

20 Nov, 2024 1 commit
- [Bugfix] Handle conflicts between modern and legacy fields (#10471) · 09dbf9ff
  Cyrus Leung authored Nov 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dbf9ff
15 Nov, 2024 2 commits
- [Bugfix] Ensure special tokens are properly filtered out for guided structured... · 691a3ec0
  Guillaume Calmettes authored Nov 15, 2024
```
[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  691a3ec0
- [Tool parsing] Improve / correct mistral tool parsing (#10333) · 11cd1ae6
  Patrick von Platen authored Nov 15, 2024
  
  11cd1ae6
11 Nov, 2024 1 commit
- [misc] improve cloudpickle registration and tests (#10202) · 73b9083e
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  73b9083e
09 Nov, 2024 1 commit

[Frontend][Core] Override HF `config.json` via CLI (#5836) · b09895a6

Krishna Mandal authored Nov 09, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

b09895a6

08 Nov, 2024 1 commit
- Fix edge case Mistral tokenizer (#10152) · 0535e5fe
  Patrick von Platen authored Nov 08, 2024
  
  0535e5fe
07 Nov, 2024 2 commits
- Adds method to read the pooling types from model's files (#9506) · aa9078fa
  Flávia Béo authored Nov 07, 2024
```
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  aa9078fa
- [Misc] Consolidate ModelConfig code related to HF config (#10104) · db7db4aa
  Cyrus Leung authored Nov 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db7db4aa
06 Nov, 2024 2 commits
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
- [Bugfix] Fix edge-case crash when using chat with the Mistral Tekken Tokenizer (#10051) · 2bcbae70
  Travis Johnson authored Nov 05, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  2bcbae70
04 Nov, 2024 1 commit

[Model] Add support for H2OVL-Mississippi models (#9747) · 54597724

shanshan wang authored Nov 03, 2024


Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

54597724

01 Nov, 2024 1 commit

[Bugfix] Fix edge cases for MistralTokenizer (#9625) · 1dd4cb29

Travis Johnson authored Nov 01, 2024


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

1dd4cb29

29 Oct, 2024 2 commits
- [Bugfix][Frontend] Guard against bad token ids (#9634) · 67bdf8e5
  Joe Runde authored Oct 29, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  67bdf8e5
- Fix the log to correct guide user to install modelscope (#9793) · 08600ddc
  tastelikefeet authored Oct 30, 2024
```
Signed-off-by: yuze.zyz <yuze.zyz@alibaba-inc.com>
```
  08600ddc
24 Oct, 2024 2 commits
- 增加medusa并行解码功能,后续增加使用说明和测试文档 · 19bc93d9
  王敏 authored Oct 24, 2024
  
  19bc93d9
- [Bugfix] TypeError: ChatGLMTokenizer._pad() got an unexpected keyword argument 'padding_side' · 3bda0405
  zhuwenwen authored Oct 24, 2024
  
  3bda0405
22 Oct, 2024 3 commits
- [Bugfix] fix detokenizer shallow copy (#5919) · 23b899a8
  Aurick Qiao authored Oct 22, 2024
  
  23b899a8
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
19 Oct, 2024 1 commit
- [Bugfix] Fix offline mode when using `mistral_common` (#9457) · 337ed766
  sasha0552 authored Oct 19, 2024
  
  337ed766
18 Oct, 2024 2 commits
- [Model] Support Pixtral models in the HF Transformers format (#9036) · 3921a2f2
  Michael Goin authored Oct 18, 2024
  
  3921a2f2
- [CI/Build] Fix lint errors in mistral tokenizer (#9504) · 1bbbcc0b
  Cyrus Leung authored Oct 19, 2024
  
  1bbbcc0b
17 Oct, 2024 1 commit
- [Bugfix] Allow prefill of assistant response when using `mistral_common` (#9446) · 5e443b59
  sasha0552 authored Oct 17, 2024
  
  5e443b59
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
12 Oct, 2024 1 commit
- [bugfix] fix f-string for error (#9295) · d11b46f3
  Prashant Gupta authored Oct 11, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  d11b46f3
11 Oct, 2024 2 commits
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Misc] Update config loading for Qwen2-VL and remove Granite · a7e72c36
  zhuwenwen authored Oct 11, 2024
  
  a7e72c36
07 Oct, 2024 1 commit
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
05 Oct, 2024 1 commit
- [Bugfix] Deprecate registration of custom configs to huggingface (#9083) · cfadb9c6
  Chen Zhang authored Oct 05, 2024
  
  cfadb9c6
28 Sep, 2024 1 commit
- [Bugfix] Fix code for downloading models from modelscope (#8443) · 39d3f8d9
  tastelikefeet authored Sep 28, 2024
  
  39d3f8d9