- 03 Dec, 2024 2 commits
-
-
myhloli authored
- Update VRAM checking logic in app.py and model_utils.py - Add None and type checks for VRAM values - Adjust concurrency limit calculation in app.py - Modify clean_vram function to handle cases with no VRAM information
-
myhloli authored
- Add get_concurrency_limit function to calculate concurrency limit based on VRAM - Update clean_vram function and rename to get_vram for better clarity - Apply concurrency limit to the to_markdown function in the Gradio app
-
- 15 Nov, 2024 1 commit
-
-
myhloli authored
-