• Chen Xin's avatar
    support image_embs input (#799) · b190521b
    Chen Xin authored
    * support image_embs input
    
    * add some checks
    
    * update interactive/config.pbtxt && TurbomindModelConfig
    
    * update docstring
    
    * refactor
    
    * support convert embeddings to bf16
    
    * update interactive/config.pbtxt
    
    * embeddings -> input_embeddings
    
    * use input_embedding_ranges
    
    * remove embedding_begins/ends
    b190521b
LlamaV2.cc 23 KB