• Jesse Gross's avatar
    runner.go: Increase survivability of main processing loop · 8a35bb92
    Jesse Gross authored
    Currently, if an error occurs during the prep stages (such as
    tokenizing) of a single request, it will only affect that request.
    However, if an error happens during decoding, it can take down the
    entire runner.
    
    Instead, it's better to drop the tokens that triggered the error and try to
    keep going. However, we also need to stop when we run out of tokens,
    otherwise, this just causes an infinite loop. This is likely the cause
    of at least some of the hanging issues that have been reported.
    
    Bug #7573
    8a35bb92
runner.go 24.6 KB