• Devon Rifkin's avatar
    model: fix boundary in bpe · fc5fb09f
    Devon Rifkin authored
    0x007e is a tilde and was getting adjusted (+0x00a2) to 0x0120 in the
    encode, but then in the decode it was getting adjusted down (-0x0100) to
    0x0020. The boundary for the +0x00a2 case has been adjusted to fix this
    
    Fixes: #11966
    fc5fb09f
bytepairencoding.go 5.32 KB