1. 14 Aug, 2023 1 commit
    • Li Zhang's avatar
      [Feature] Blazing fast W4A16 inference (#202) · c3290cad
      Li Zhang authored
      * add w4a16
      
      * fix `deploy.py`
      
      * add doc
      
      * add w4a16 kernels
      
      * fuse w1/w3 & bugfixes
      
      * fix typo
      
      * python
      
      * guard sm75/80 features
      
      * add missing header
      
      * refactor
      
      * qkvo bias
      
      * update cost model
      
      * fix lint
      
      * update `deploy.py`
      c3290cad
  2. 03 Aug, 2023 1 commit
  3. 31 Jul, 2023 1 commit
  4. 21 Jul, 2023 1 commit
  5. 06 Jul, 2023 1 commit
  6. 04 Jul, 2023 1 commit
  7. 03 Jul, 2023 1 commit
  8. 01 Jul, 2023 2 commits