• Baptiste Jamin's avatar
    server: add logprobs and top_logprobs support to Ollama's API (#12899) · 59241c5b
    Baptiste Jamin authored
    
    
    Adds logprobs support to Ollama's API including support for Ollama's
    OpenAI-compatible API. By specifying the new 'logprobs' boolean parameter
    in the API, Ollama will return the log probabilities for each token generated.
    'top_logprobs', an integer value can also be specified up to the value 20.
    When specified, the API will also provide the number of most likely tokens to
    return at each token position
    Co-authored-by: default avatarBaptiste Jamin <baptiste@crisp.chat>
    59241c5b
types.go 33.5 KB