• Jesse Gross's avatar
    runner.go: Add unit tests for context shifting · 2cd11ae3
    Jesse Gross authored
    This also makes it easier to truncate long inputs the same as
    shifting but does not actually implement it. This type of
    truncation has a trade off between quality and time to first
    token.
    2cd11ae3
cache.go 6.05 KB