• Karim Foda's avatar
    Add hallucination filter (#18675) · b9403e95
    Karim Foda authored
    
    
    * Add hallucination penalty
    
    * Make quality changes
    
    * Inverse penalty
    
    * Fix imports & quality
    
    * Fix name spelling issue
    
    * set encoder_repetition_penalty and fix quality
    
    * Fix failing test
    
    * Add to config_common_kwargs
    
    * Fix modelling_rag error
    
    * Update src/transformers/generation_logits_process.py
    Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
    
    * Remove breakpoint
    
    * Make style fixes
    
    * Update encoder_repetition_penalty default value
    
    * Merge latest main changes
    
    * Make fixup changes
    
    * Add EncoderRepetitionPenaltyLogitsProcessor to generation/__init__.py
    
    * Fix repo-inconsistency
    
    * Remove venv
    
    * Remove tensorflow-macos & add tests
    
    * Add documentation
    
    * Fix quality issues
    
    * move encoder_repetition_penalty to config
    
    * Update src/transformers/configuration_utils.py
    Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
    
    * Update src/transformers/generation/configuration_utils.py
    Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
    
    * Remove encoder_repetition_penalty from tests
    
    * Fix type error
    
    * Fix format error
    Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
    b9403e95
test_logits_process.py 30.1 KB