- 31 Jan, 2023 1 commit
-
-
OlivierDehaene authored
Add token streaming using ServerSideEvents (SSE). The signature of the SSE events is: ```rust struct Details { finish_reason: String, generated_tokens: u32, seed: Option<u64>, } struct StreamResponse { token: Token, generated_text: Option<String>, details: Option<Details>, } struct ErrorResponse { error: String, } ```
-
- 30 Jan, 2023 1 commit
-
-
OlivierDehaene authored
Co-authored-by:Yannic Kilcher <yk@users.noreply.github.com>
-
- 23 Jan, 2023 2 commits
-
-
OlivierDehaene authored
-
OlivierDehaene authored
-
- 15 Dec, 2022 1 commit
-
-
OlivierDehaene authored
-
- 12 Dec, 2022 1 commit
-
-
OlivierDehaene authored
-
- 05 Dec, 2022 1 commit
-
-
Nick Hill authored
- Avoid theoretical hang in batcher loop - Avoid a couple of clones in the router generate method - Keep attention mask tensors as integers - Remove num_heads attribute Co-authored-by:OlivierDehaene <Olivier.dehaene@gmail.com>
-
- 04 Nov, 2022 1 commit
-
-
OlivierDehaene authored
-
- 28 Oct, 2022 1 commit
-
-
OlivierDehaene authored
-
- 27 Oct, 2022 1 commit
-
-
OlivierDehaene authored
-
- 21 Oct, 2022 1 commit
-
-
OlivierDehaene authored
-
- 20 Oct, 2022 1 commit
-
-
Olivier Dehaene authored
-
- 17 Oct, 2022 2 commits
-
-
Olivier Dehaene authored
-
Olivier Dehaene authored
-
- 15 Oct, 2022 1 commit
-
-
Olivier Dehaene authored
-
- 14 Oct, 2022 1 commit
-
-
Olivier Dehaene authored
-
- 11 Oct, 2022 4 commits
-
-
Olivier Dehaene authored
-
Olivier Dehaene authored
-
Olivier Dehaene authored
Added validation logic
-
Olivier Dehaene authored
-
- 08 Oct, 2022 1 commit
-
-
Olivier Dehaene authored
-