• Mo Li's avatar
    Added support for multi-needle testing in needle-in-a-haystack test (#802) · acae5609
    Mo Li authored
    
    
    * Add NeedleInAHaystack Test
    
    * Apply pre-commit formatting
    
    * Update configs/eval_hf_internlm_chat_20b_cdme.py
    Co-authored-by: default avatarSongyang Zhang <tonysy@users.noreply.github.com>
    
    * add needle in haystack test
    
    * update needle in haystack test
    
    * update plot function in tools_needleinahaystack.py
    
    * optimizing needleinahaystack dataset generation strategy
    
    * modify minor formatting issues
    
    * add English version support
    
    * change NeedleInAHaystackDataset to dynamic loading
    
    * change NeedleInAHaystackDataset to dynamic loading
    
    * fix needleinahaystack test eval bug
    
    * fix needleinahaystack config bug
    
    * Added support for multi-needle testing in needle-in-a-haystack test
    
    * Optimize the code for plotting in the needle-in-a-haystack test.
    
    * Correct the typo in the dataset parameters.
    
    * update needleinahaystack test docs
    
    ---------
    Co-authored-by: default avatarSongyang Zhang <tonysy@users.noreply.github.com>
    acae5609
tools_needleinahaystack.py 4.94 KB