docs/source/en/perf_infer_gpu_one.mdx · 1e4cf8bb446fcbfcd428b15377bd12e254ad8baa · chenpangpang / transformers

Add tips for generation with Int8 models (#21424) · b7bb2b59

lewtun authored Feb 06, 2023



* Add tips for generation with Int8 models

* Empty commit to trigger CI

* Apply suggestions from code review
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update docs/source/en/perf_infer_gpu_one.mdx
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

---------
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

b7bb2b59

perf_infer_gpu_one.mdx 5.58 KB

Replace perf_infer_gpu_one.mdx