1. 03 Dec, 2024 2 commits
    • myhloli's avatar
      fix(vram): improve VRAM checking logic · 104273cc
      myhloli authored
      - Update VRAM checking logic in app.py and model_utils.py
      - Add None and type checks for VRAM values
      - Adjust concurrency limit calculation in app.py
      - Modify clean_vram function to handle cases with no VRAM information
      104273cc
    • myhloli's avatar
      feat(gradio_app): implement dynamic concurrency limit based on VRAM · b1fe9d4f
      myhloli authored
      - Add get_concurrency_limit function to calculate concurrency limit based on VRAM
      - Update clean_vram function and rename to get_vram for better clarity
      - Apply concurrency limit to the to_markdown function in the Gradio app
      b1fe9d4f
  2. 15 Nov, 2024 1 commit