• drbh's avatar
    Support qwen2 vl (#2689) · befd9f67
    drbh authored
    * feat: add support for qwen2 vl model
    
    * feat: fix token padding, enable warmup and process basic request
    
    * fix: improve get_position_ids, add lift embed_tokens
    
    * fix: remove get_cos_sin_hack dev function
    
    * feat: add simple test chat with meesage and text
    
    * fix: lint test
    
    * fix: adjust positional embeddings for multi dimensional position ids
    
    * fix: update docs and lint unused vars
    
    * fix: include linted file
    
    * fix: add norm after text output
    
    * fix: format model file
    
    * fix: adjust for ruff lints
    
    * fix: remove unused rotate_half
    
    * feat: refactors and calc num features
    
    * fix: prefer position_ids passed from vlm causal lm and reset ids on batch
    
    * fix: adjust get_position_ids if not available and add required args to signatures
    
    * fix: adjust resize case for qwen2_vl warmup
    
    * fix: avoid qwen2 vl specific paths with qwen2
    befd9f67
supported_models.md 2.97 KB