"research/object_detection/protos/model.proto" did not exist on "60c3ed2e34efbe428ae04ab99ccebd795187c12f"
  • Jesse Gross's avatar
    ollamarunner: Multi-modal worst case graph · fe623c2c
    Jesse Gross authored
    We currently preallocate compute graph memory for the worst case
    batch of text tokens. This adds support for doing the same for
    images.
    
    Note that image models are more complicated than text models in
    how they process their inputs so there may be cases where this
    approach isn't completely generic for all models. It covers all
    currently supported models though.
    fe623c2c
runner.go 25.3 KB