"api/examples/generate-streaming/main.go" did not exist on "1a83581a8e1063418f5f1fec14638409d0681b68"
  1. 14 Aug, 2023 1 commit
    • Li Zhang's avatar
      [Feature] Blazing fast W4A16 inference (#202) · c3290cad
      Li Zhang authored
      * add w4a16
      
      * fix `deploy.py`
      
      * add doc
      
      * add w4a16 kernels
      
      * fuse w1/w3 & bugfixes
      
      * fix typo
      
      * python
      
      * guard sm75/80 features
      
      * add missing header
      
      * refactor
      
      * qkvo bias
      
      * update cost model
      
      * fix lint
      
      * update `deploy.py`
      c3290cad
  2. 21 Jul, 2023 1 commit
  3. 01 Jul, 2023 3 commits
  4. 24 Jun, 2023 1 commit
  5. 20 Jun, 2023 1 commit