• Robert Clark's avatar
    Add temperature to the server API · 527e07c0
    Robert Clark authored
    
    
    A temperature value between 0.0 and 100.0 can now be specified via the API
    while running the text generation server. The value passed to
    --temperature while running the text generation server is kept as the
    default value for all API calls that don't include temperature, even if
    different values were manually specified previously.
    Signed-Off-By: default avatarRobert Clark <roclark@nvidia.com>
    527e07c0
text_generation_server.py 3.49 KB