Commits · a7d87540b65820b08eaafeecbbe5a10d18220079 · OpenDAS / AutoAWQ

30 Oct, 2023 1 commit
- CUDA 11.8.0 and 12.1.1 build (#128) · a7d87540
  Casper authored Oct 30, 2023
  
  a7d87540
29 Oct, 2023 1 commit
- Pseudo dequantize function (#127) · f1a2e56e
  Casper authored Oct 29, 2023
  
  f1a2e56e
28 Oct, 2023 6 commits
- Bump to v0.1.5 · b9ed6641
  Casper authored Oct 28, 2023
  
  b9ed6641
- Add benchmark of Aquila2 34B AWQ in README.md. (#126) · d6ac3be3
  ldwang authored Oct 29, 2023
```
Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
```
  d6ac3be3
- Support Aquila models. (#123) · dc13f0b8
  ldwang authored Oct 28, 2023
```
Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>
```
  dc13f0b8
- Fixing starcoder based models with 15B (#118) · 6c05f669
  Sebastian Bodza authored Oct 28, 2023
  
  6c05f669
- Fix potential overflow (#102) · 0cadd65f
  Casper authored Oct 28, 2023
  
  0cadd65f
- [`core`] Support fp32 / bf16 inference (#121) · 18712d00
  Younes Belkada authored Oct 28, 2023
  
  18712d00
27 Oct, 2023 1 commit
- 400 -> 600 models available · 26e94d2e
  Casper authored Oct 27, 2023
  
  26e94d2e
25 Oct, 2023 1 commit
- Update symbol to downloads/month · e539be9a
  Casper authored Oct 25, 2023
  
  e539be9a
20 Oct, 2023 1 commit
- Merge pull request #113 from twaka/gpt_neox · be395987
  Casper authored Oct 20, 2023
```
add gpt_neox support
```
  be395987
19 Oct, 2023 1 commit
- add comments · bcfdeb38
  twaka authored Oct 17, 2023
  
  bcfdeb38
17 Oct, 2023 1 commit
- gpt_neox · ad45716f
  twaka authored Oct 17, 2023
  
  ad45716f
07 Oct, 2023 2 commits
- Merge pull request #96 from casper-hansen/fix_attention_mask · 1b54b9f9
  Casper authored Oct 07, 2023
```
Only apply attention mask if seqlen is greater than 1
```
  1b54b9f9
- Only apply attention mask if seqlen is greater than 1 · e94b7f40
  Casper Hansen authored Oct 07, 2023
  
  e94b7f40
06 Oct, 2023 10 commits
- Bump to v0.1.4 · 0baf5e18
  Casper authored Oct 06, 2023
  
  0baf5e18
- Merge pull request #95 from casper-hansen/cache_refactor · 1b68975a
  Casper authored Oct 06, 2023
```
Refactor cache and embedding modules
```
  1b68975a
- Remove attention sinks · b13e2a85
  Casper Hansen authored Oct 06, 2023
  
  b13e2a85
- Create RoPE module · 69733d2c
  Casper Hansen authored Oct 06, 2023
  
  69733d2c
- Move attention shapes to fused_utils · 306de683
  Casper Hansen authored Oct 06, 2023
  
  306de683
- Create ALiBi module · 428504e4
  Casper Hansen authored Oct 06, 2023
  
  428504e4
- Update comment · 7a3d06d6
  Casper Hansen authored Oct 06, 2023
  
  7a3d06d6
- Update Mistral example · 204a3a12
  Casper Hansen authored Oct 06, 2023
  
  204a3a12
- Use new WindowedCache · e46703d8
  Casper Hansen authored Oct 06, 2023
  
  e46703d8
- Create cache for fused modules · 66b2e233
  Casper Hansen authored Oct 06, 2023
  
  66b2e233
05 Oct, 2023 7 commits
- Update README.md · c9e45270
  Casper authored Oct 05, 2023
  
  c9e45270
- Update README.md · 76f3142b
  Casper authored Oct 05, 2023
  
  76f3142b
- Remove warning · 661047f1
  Casper authored Oct 05, 2023
  
  661047f1
- Bump transformers to 4.34.0 · 1d0e1285
  Casper authored Oct 05, 2023
  
  1d0e1285
- Bump to v0.1.3 · a6ecd0db
  Casper authored Oct 05, 2023
  
  a6ecd0db
- Merge pull request #92 from casper-hansen/turing_support · 70d52977
  Casper authored Oct 05, 2023
```
Turing inference support (Colab+Kaggle working)
```
  70d52977
- Remove past_key_value (save 2GB VRAM) · 40e6952a
  Casper Hansen authored Oct 05, 2023
  
  40e6952a
03 Oct, 2023 2 commits
- Standardize asm volatile (Windows Support) · 712e1834
  Casper authored Oct 03, 2023
  
  712e1834
- Turing support (initial) · 7c59407c
  Casper Hansen authored Oct 03, 2023
  
  7c59407c
02 Oct, 2023 6 commits
- Bump to v0.1.2 · eccb8f9c
  Casper Hansen authored Oct 02, 2023
  
  eccb8f9c
- Merge pull request #90 from casper-hansen/mistral_fused · 11efba09
  Casper authored Oct 02, 2023
```
Mistral fused modules
```
  11efba09
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
- Merge pull request #89 from casper-hansen/falcon_fix_kv_heads · aaab103b
  Casper authored Oct 02, 2023
```
Fix Falcon n_kv_heads parameter
```
  aaab103b
- Merge pull request #88 from casper-hansen/fix_padding_mask · a4ea423d
  Casper authored Oct 02, 2023
```
Fix unexpected keyword
```
  a4ea423d