Commits · a7e72c36e2b6241f97f27fa8436ff8434e62af3f · OpenDAS / vllm_cscc · GitLab

11 Oct, 2024 1 commit
- [Misc] Update config loading for Qwen2-VL and remove Granite · a7e72c36
  zhuwenwen authored Oct 11, 2024
  
  a7e72c36
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

18 Sep, 2024 1 commit
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
12 Sep, 2024 2 commits
- [Bugfix] Offline mode fix (#8376) · f2e263b8
  Joe Runde authored Sep 12, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  f2e263b8
- [Hotfix][VLM] Fixing max position embeddings for Pixtral (#8399) · 520ca380
  Roger Wang authored Sep 12, 2024
  
  520ca380
11 Sep, 2024 1 commit
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
06 Sep, 2024 2 commits
- [Model] Allow loading from original Mistral format (#8168) · 29f49cd6
  Patrick von Platen authored Sep 07, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  29f49cd6
- [BugFix] Fix Granite model configuration (#8216) · baa54675
  Nick Hill authored Sep 05, 2024
  
  baa54675
02 Sep, 2024 1 commit
- [Core][Bugfix] Accept GGUF model without .gguf extension (#8056) · 4ca65a97
  Isotr0py authored Sep 02, 2024
  
  4ca65a97
31 Aug, 2024 1 commit
- [Bugfix] Fix ModelScope models in v0.5.5 (#8037) · 4f5d8446
  Nicolò Lucchesi authored Aug 31, 2024
  
  4f5d8446
30 Aug, 2024 1 commit
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
22 Aug, 2024 2 commits
- [Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830) · a3fce56b
  Abhinav Goyal authored Aug 22, 2024
  
  a3fce56b
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
05 Aug, 2024 1 commit
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
26 Jul, 2024 1 commit
- [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611) · 07278c37
  Michael Goin authored Jul 26, 2024
  
  07278c37
23 Jul, 2024 1 commit
- Bump `transformers` version for Llama 3.1 hotfix and patch Chameleon (#6690) · 1bedf210
  Roger Wang authored Jul 23, 2024
  
  1bedf210
22 Jul, 2024 1 commit
- [Model] Initial Support for Chameleon (#5770) · c9eef37f
  Roger Wang authored Jul 21, 2024
  
  c9eef37f
10 Jul, 2024 1 commit
- [Speculative Decoding] Medusa Implementation with Top-1 proposer (#4978) · 2416b26e
  Abhinav Goyal authored Jul 10, 2024
  
  2416b26e
29 Jun, 2024 1 commit
- [Bugfix] Support `eos_token_id` from `config.json` (#5954) · 51e971d3
  Cyrus Leung authored Jun 29, 2024
  
  51e971d3
21 Jun, 2024 1 commit

[Model] MLPSpeculator speculative decoding support (#4947) · b12518d3

Joshua Rosenkranz authored Jun 20, 2024


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>

b12518d3

11 Jun, 2024 2 commits
- [Frontend] Customizable RoPE theta (#5197) · dcbf4286
  sasha0552 authored Jun 11, 2024
  
  dcbf4286
- [Misc] Various simplifications and typing fixes (#5368) · a0086298
  Nick Hill authored Jun 10, 2024
  
  a0086298
06 Jun, 2024 1 commit
- Bugfix: fix broken of download models from modelscope (#5233) · 4efff036
  liuyhwangyh authored Jun 07, 2024
```
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
```
  4efff036
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

22 May, 2024 1 commit
- [Frontend] Dynamic RoPE scaling (#4638) · 9b9a10d6
  sasha0552 authored May 22, 2024
  
  9b9a10d6
12 Apr, 2024 2 commits
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
27 Mar, 2024 1 commit
- [Model] Add support for DBRX (#3660) · e24336b5
  Megha Agarwal authored Mar 27, 2024
  
  e24336b5
25 Mar, 2024 1 commit
- [Feature] Add vision language model support. (#3042) · 64172a97
  xwjiang2010 authored Mar 25, 2024
  
  64172a97
21 Mar, 2024 2 commits
- [Misc] Bump up transformers to v4.39.0 & Remove StarCoder2Config (#3551) · c188ecb0
  Woosuk Kwon authored Mar 21, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
Co-authored-by: Roger Meier <r.meier@siemens.com>
```
  c188ecb0
- [🚀 Ready to be merged] Added support for Jais models (#3183) · 4c07dd28
  Lalit Pradhan authored Mar 21, 2024
  
  4c07dd28
29 Feb, 2024 1 commit
- Support starcoder2 architecture (#3089) · bfdcfa6a
  Seonghyeon authored Feb 29, 2024
  
  bfdcfa6a
27 Feb, 2024 1 commit
- [Minor] Remove unused config files (#3039) · d9f726c4
  Roy authored Feb 27, 2024
  
  d9f726c4
18 Feb, 2024 1 commit
- Add code-revision config argument for Hugging Face Hub (#2892) · 786b7f18
  Mark Mozolewski authored Feb 17, 2024
  
  786b7f18
14 Feb, 2024 1 commit
- Migrate AquilaForCausalLM to LlamaForCausalLM (#2867) · 4efbac6d
  Roy authored Feb 15, 2024
  
  4efbac6d
13 Feb, 2024 3 commits
- Remove Yi model definition, please use `LlamaForCausalLM` instead (#2854) · 317b29de
  Philipp Moritz authored Feb 13, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
```
  317b29de
- Revert "Refactor llama family models (#2637)" (#2851) · ea356004
  Philipp Moritz authored Feb 13, 2024
```
This reverts commit 5c976a7e.
```
  ea356004
- Refactor llama family models (#2637) · 5c976a7e
  Roy authored Feb 13, 2024
  
  5c976a7e