- 23 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 22 Aug, 2024 2 commits
- 21 Aug, 2024 2 commits
- 20 Aug, 2024 2 commits
- 19 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 17 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 16 Aug, 2024 1 commit
-
-
gaoqiong authored
-
- 15 Aug, 2024 3 commits
- 09 Aug, 2024 1 commit
-
-
gaoqiong authored
-
- 08 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 06 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 04 Aug, 2024 3 commits
- 01 Aug, 2024 1 commit
-
-
zhuwenwen authored
-
- 24 Jul, 2024 2 commits
- 22 Jul, 2024 1 commit
-
-
zhuwenwen authored
-
- 20 Jul, 2024 5 commits
- 17 Jul, 2024 1 commit
-
-
zhuwenwen authored
-
- 09 Jul, 2024 1 commit
-
-
huangwb authored
-
- 08 Jul, 2024 1 commit
-
-
zhuwenwen authored
-
- 06 Jul, 2024 1 commit
-
-
zhuwenwen authored
-
- 01 Jul, 2024 1 commit
-
-
zhuwenwen authored
-
- 28 Jun, 2024 1 commit
-
-
zhuwenwen authored
-
- 13 Jun, 2024 5 commits
-
-
Tyler Michael Smith authored
-
Tyler Michael Smith authored
Co-authored-by:
Michael Goin <michael@neuralmagic.com> Co-authored-by:
youkaichao <youkaichao@gmail.com> Co-authored-by:
zifeitong <zifei.tong@parasail.io> Co-authored-by:
Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
-
Cyrus Leung authored
Co-authored-by:Roger Wang <ywang@roblox.com>
-
wenyujin333 authored
Tune Qwen2-57B-A14B configs based on #4921 Throughput Performance command: python benchmarks/benchmark_throughput.py --model=Qwen/Qwen2-57B-A14B-Instruct --input-len 1000 --output-len 50 -tp 2 A100 GPU benchmark no config w/ PR tp=2 10.53 requests/s, 11058.17 tokens/s 12.47 requests/s, 13088.57 tokens/s tp=4 17.77 requests/s, 18662.95 tokens/s 20.20 requests/s, 21212.32 tokens/s
-
Dipika Sikka authored
Co-authored-by:
-
- 12 Jun, 2024 1 commit
-
-
Travis Johnson authored
Signed-off-by:
Travis Johnson <tsjohnso@us.ibm.com> Co-authored-by:
Sanger Steel <sangersteel@gmail.com> Co-authored-by:
-
