• Fraser Mince's avatar
    Fix llava half precision and autocast issues (#29721) · 5090ea3f
    Fraser Mince authored
    * Ensure input_embeds and image_features are the same dtype in autocast
    
    * Fix nans in half precision llava-next and fix autocasting behavior.
    
    * Fix styling issues.
    
    * fix randn newline instantiation
    
    * fix broken slow llava test
    
    * Fix llava next init.
    
    * fix styling issues
    
    * [run-slow]llava,llava_next
    
    * fix styling issues
    5090ea3f
test_modeling_llava.py 20.4 KB