1. 31 Jan, 2023 1 commit
    • OlivierDehaene's avatar
      feat: Add token streaming using ServerSideEvents support (#36) · 7fbfbb0d
      OlivierDehaene authored
      Add token streaming using ServerSideEvents (SSE).
      
      The signature of the SSE events is: 
      
      ```rust
      struct Details {
          finish_reason: String,
          generated_tokens: u32,
          seed: Option<u64>,
      }
      
      struct StreamResponse {
          token: Token,
          generated_text: Option<String>,
          details: Option<Details>,
      }
      
      struct ErrorResponse {
          error: String,
      }
      ```
      7fbfbb0d
  2. 30 Jan, 2023 1 commit
  3. 15 Dec, 2022 1 commit
  4. 12 Dec, 2022 1 commit
  5. 27 Oct, 2022 1 commit
  6. 21 Oct, 2022 1 commit
  7. 20 Oct, 2022 1 commit
  8. 17 Oct, 2022 2 commits