"...text-generation-inference.git" did not exist on "efd602c8207c90908fc4cd127235f1b57e741814"
perf(magic_pdf): optimize batch ratio calculation for GPU
- Update GPU memory check and batch ratio calculation logic - Add support for virtual VRAM size environment variable - Improve logging for GPU memory and batch ratio
Showing
Please register or sign in to comment