Commits · 1b54b9f993c25f740ea8be988aa887593e53a809 · OpenDAS / AutoAWQ

07 Oct, 2023 2 commits
- Merge pull request #96 from casper-hansen/fix_attention_mask · 1b54b9f9
  Casper authored Oct 07, 2023
```
Only apply attention mask if seqlen is greater than 1
```
  1b54b9f9
- Only apply attention mask if seqlen is greater than 1 · e94b7f40
  Casper Hansen authored Oct 07, 2023
  
  e94b7f40
06 Oct, 2023 10 commits
- Bump to v0.1.4 · 0baf5e18
  Casper authored Oct 06, 2023
  
  0baf5e18
- Merge pull request #95 from casper-hansen/cache_refactor · 1b68975a
  Casper authored Oct 06, 2023
```
Refactor cache and embedding modules
```
  1b68975a
- Remove attention sinks · b13e2a85
  Casper Hansen authored Oct 06, 2023
  
  b13e2a85
- Create RoPE module · 69733d2c
  Casper Hansen authored Oct 06, 2023
  
  69733d2c
- Move attention shapes to fused_utils · 306de683
  Casper Hansen authored Oct 06, 2023
  
  306de683
- Create ALiBi module · 428504e4
  Casper Hansen authored Oct 06, 2023
  
  428504e4
- Update comment · 7a3d06d6
  Casper Hansen authored Oct 06, 2023
  
  7a3d06d6
- Update Mistral example · 204a3a12
  Casper Hansen authored Oct 06, 2023
  
  204a3a12
- Use new WindowedCache · e46703d8
  Casper Hansen authored Oct 06, 2023
  
  e46703d8
- Create cache for fused modules · 66b2e233
  Casper Hansen authored Oct 06, 2023
  
  66b2e233
05 Oct, 2023 7 commits
- Update README.md · c9e45270
  Casper authored Oct 05, 2023
  
  c9e45270
- Update README.md · 76f3142b
  Casper authored Oct 05, 2023
  
  76f3142b
- Remove warning · 661047f1
  Casper authored Oct 05, 2023
  
  661047f1
- Bump transformers to 4.34.0 · 1d0e1285
  Casper authored Oct 05, 2023
  
  1d0e1285
- Bump to v0.1.3 · a6ecd0db
  Casper authored Oct 05, 2023
  
  a6ecd0db
- Merge pull request #92 from casper-hansen/turing_support · 70d52977
  Casper authored Oct 05, 2023
```
Turing inference support (Colab+Kaggle working)
```
  70d52977
- Remove past_key_value (save 2GB VRAM) · 40e6952a
  Casper Hansen authored Oct 05, 2023
  
  40e6952a
03 Oct, 2023 2 commits
- Standardize asm volatile (Windows Support) · 712e1834
  Casper authored Oct 03, 2023
  
  712e1834
- Turing support (initial) · 7c59407c
  Casper Hansen authored Oct 03, 2023
  
  7c59407c
02 Oct, 2023 8 commits
- Bump to v0.1.2 · eccb8f9c
  Casper Hansen authored Oct 02, 2023
  
  eccb8f9c
- Merge pull request #90 from casper-hansen/mistral_fused · 11efba09
  Casper authored Oct 02, 2023
```
Mistral fused modules
```
  11efba09
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
- Merge pull request #89 from casper-hansen/falcon_fix_kv_heads · aaab103b
  Casper authored Oct 02, 2023
```
Fix Falcon n_kv_heads parameter
```
  aaab103b
- Merge pull request #88 from casper-hansen/fix_padding_mask · a4ea423d
  Casper authored Oct 02, 2023
```
Fix unexpected keyword
```
  a4ea423d
- Fix Falcon n_kv_heads parameter · 80eea43e
  Casper Hansen authored Oct 02, 2023
  
  80eea43e
- Fix unexpected keyword · d016c513
  Casper Hansen authored Oct 02, 2023
  
  d016c513
01 Oct, 2023 2 commits
- Merge pull request #84 from casper-hansen/fix_ghwf · 3fa74007
  Casper authored Oct 01, 2023
```
Faster build, fix "no space left".
```
  3fa74007
- Faster build, fix "no space left". · 8f05eaef
  Casper authored Oct 01, 2023
  
  8f05eaef
27 Sep, 2023 9 commits
- Add badges · 20cd7981
  Casper authored Sep 27, 2023
  
  20cd7981
- Bump to v0.1.1 · 6bdcd786
  Casper authored Sep 27, 2023
  
  6bdcd786
- Merge pull request #77 from s4rduk4r/offloading · f220ccf1
  Casper authored Sep 27, 2023
```
Offloading to cpu and disk
```
  f220ccf1
- Merge pull request #80 from casper-hansen/low_cpu_mem_example · 8793a9f7
  Casper authored Sep 27, 2023
```
Add low_cpu_mem_usage=True in example
```
  8793a9f7
- Add low_cpu_mem_usage=True in example · aa6497cd
  Casper Hansen authored Sep 27, 2023
  
  aa6497cd
- Merge pull request #79 from casper-hansen/mistral · 1c5ccc79
  Casper authored Sep 27, 2023
```
Mistral support
```
  1c5ccc79
- Add exception handling · 1ac3f976
  Casper Hansen authored Sep 27, 2023
  
  1ac3f976
- Mistral support · bd56c301
  Casper Hansen authored Sep 27, 2023
  
  bd56c301
- Fix apply_rotary_emb() to have both tensors on the same device · 841a2313
  s4rduk4r authored Sep 27, 2023
  
  841a2313