-
myhloli authored
- Increase batch ratio to 8 for GPU memory >=16GB - Improve inference performance on systems with higher GPU memory
0b05dff7
- Increase batch ratio to 8 for GPU memory >=16GB - Improve inference performance on systems with higher GPU memory