Skip to content

GitLab

Switch branch/tag
  1. 09 May, 2023 3 commits
  3. 05 May, 2023 3 commits
    • Nicolas Patry's avatar
      fea(server): decrease convert RAM requirements (#286) · b4aa87db
      Nicolas Patry authored
      b4aa87db
    • Nicolas Patry's avatar
      chore: add `flash-attention` to docker ignore (#287) · 3314a46d
      Nicolas Patry authored 
      included when building docker locally.
(Where the local dirs might have the flash-attention folder.)


# What does this PR do?

<!--
Congratulations! You've made it this far! You're not quite done yet
though.

Once merged, your PR is going to appear in the release notes with the
title you set, so make sure it's a great title that fully reflects the
extent of your awesome contribution.

Then, please replace this with a description of the change and which
issue is fixed (if applicable). Please also include relevant motivation
and context. List any dependencies (if any) that are required for this
change.

Once you're done, someone will review your PR shortly (see the section
"Who can review?" below to tag some potential reviewers). They may
suggest changes to make the code even better. If no one reviewed your PR
after a week has passed, don't hesitate to post a new comment
@-mentioning the same persons---sometimes notifications get l...
      3314a46d
    • Nicolas Patry's avatar
      fix(server): fix convert (#284) · 690fc317
      Nicolas Patry authored
      690fc317
  5. 04 May, 2023 3 commits
  7. 03 May, 2023 3 commits
  9. 02 May, 2023 1 commit
  11. 01 May, 2023 1 commit
    • Nicolas Patry's avatar
      Adding docs on how dynamic batching works. (#258) · e86cca97
      Nicolas Patry authored 
      This PR starts the minimal possible amount of explanation I could think
of. It tries to explain how dynamic batching occurs, the interactions
with past key values and ignores the padding problem.

Maybe some drawings could help too but I kept it to text for now.
      e86cca97
  13. 29 Apr, 2023 2 commits
  15. 27 Apr, 2023 5 commits
  17. 26 Apr, 2023 3 commits
  19. 25 Apr, 2023 5 commits
  21. 24 Apr, 2023 3 commits
  23. 21 Apr, 2023 8 commits