- 03 Mar, 2023 3 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 02 Mar, 2023 1 commit
-
-
OlivierDehaene authored
-
- 24 Feb, 2023 4 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 20 Feb, 2023 1 commit
-
-
OlivierDehaene authored
closes #80
-
- 18 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 16 Feb, 2023 2 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 15 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 14 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 13 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 08 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 07 Feb, 2023 3 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 03 Feb, 2023 1 commit
-
-
OlivierDehaene authored
-
- 02 Feb, 2023 2 commits
-
-
OlivierDehaene authored
@njhill, @yk FYI generated_text was concatenated to the user prompt for legacy reason. We want to remove this behaviour as we don't think it is useful and even detrimonial to usability. We also remove the unused Vec.
-
OlivierDehaene authored
-
- 01 Feb, 2023 3 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 31 Jan, 2023 7 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
-
OlivierDehaene authored
Reverts huggingface/text-generation-inference#36
-
OlivierDehaene authored
Add token streaming using ServerSideEvents (SSE). The signature of the SSE events is: ```rust struct Details { finish_reason: String, generated_tokens: u32, seed: Option<u64>, } struct StreamResponse { token: Token, generated_text: Option<String>, details: Option<Details>, } struct ErrorResponse { error: String, } ```
-
- 30 Jan, 2023 1 commit
-
-
OlivierDehaene authored
Co-authored-by:Yannic Kilcher <yk@users.noreply.github.com>
-
- 26 Jan, 2023 1 commit
-
-
OlivierDehaene authored
-
- 24 Jan, 2023 1 commit
-
-
OlivierDehaene authored
-
- 20 Jan, 2023 2 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 17 Jan, 2023 1 commit
-
-
Nick Hill authored
- Fix some type hints, in particular base tokenizer class - Make use of `tensor.new_zero/empty` methods - Simplify env var string parsing in launcher
-
- 05 Jan, 2023 1 commit
-
-
OlivierDehaene authored
Co-authored-by:Nick Hill <nickhill@us.ibm.com>
-
- 03 Jan, 2023 1 commit
-
-
Nicolas Patry authored
Fixes #12 in the easiest way I could think of.
-