router/src/lib.rs · 39af000cb9bfa12628c21c6e65d3ce8930250171 · OpenDAS / text-generation-inference

feat: use existing add_generation_prompt variable from config in temp… (#1533) · 17345402

drbh authored Feb 07, 2024

This PR adds support to read the `add_generation_prompt` from the config
and use it in the chat template. If `add_generation_prompt` does not
exist we default to false

17345402

lib.rs 17.4 KB

Replace lib.rs