Commits · 4acc42a6050ed6c9f9c7c9db28a0f244a45990e7 · OpenDAS / text-generation-inference

07 Feb, 2023 1 commit
- fix(server): better handling of inference mode (#57) · 4acc42a6
  OlivierDehaene authored Feb 07, 2023
  
  4acc42a6
03 Feb, 2023 1 commit
- feat(router): refactor API and add openAPI schemas (#53) · 20c3c594
  OlivierDehaene authored Feb 03, 2023
  
  20c3c594
02 Feb, 2023 1 commit
- fix(server): allow greedy repetition penalty (#51) · df227ac2
  OlivierDehaene authored Feb 02, 2023
  
  df227ac2
01 Feb, 2023 3 commits
- feat(server): allow the server to use a local weight cache (#49) · 775115e3
  OlivierDehaene authored Feb 01, 2023
  
  775115e3
- feat(server): support repetition penalty (#47) · 313194f6
  OlivierDehaene authored Feb 01, 2023
  
  313194f6
- feat(server): allow gpt-neox models with odd vocab sizes to be sharded (#48) · 2ad895a6
  OlivierDehaene authored Feb 01, 2023
  
  2ad895a6
31 Jan, 2023 3 commits
- feat(server): Support GPT-Neox (#39) · f830706b
  OlivierDehaene authored Jan 31, 2023
  
  f830706b
- fix(server): fix seeding with multiple shards (#44) · 54fec931
  OlivierDehaene authored Jan 31, 2023
  
  54fec931
- fix(server): fix seeding on gpu (#42) · 03bdf182
  OlivierDehaene authored Jan 31, 2023
  
  03bdf182
30 Jan, 2023 1 commit
- feat: Support sampling seeding (#37) · cd298bc5
  OlivierDehaene authored Jan 30, 2023
```
Co-authored-by: Yannic Kilcher <yk@users.noreply.github.com>
```
  cd298bc5
20 Jan, 2023 1 commit
- feat(server): Support SantaCoder (#26) · 15511edc
  OlivierDehaene authored Jan 20, 2023
  
  15511edc
17 Jan, 2023 1 commit

fix(server): Minor refactorization using new_zeros (#24) · e6d3eb5d

Nick Hill authored Jan 17, 2023

- Fix some type hints, in particular base tokenizer class
- Make use of `tensor.new_zero/empty` methods
- Simplify env var string parsing in launcher

e6d3eb5d

16 Dec, 2022 1 commit
- fix(server): Fix stop sequences (#11) · 611e21cb
  OlivierDehaene authored Dec 16, 2022
  
  611e21cb
15 Dec, 2022 1 commit
- feat: Return logprobs (#8) · 32a25306
  OlivierDehaene authored Dec 15, 2022
  
  32a25306
12 Dec, 2022 1 commit
- feat: Support stop sequences (#7) · 718096f6
  OlivierDehaene authored Dec 12, 2022
  
  718096f6
08 Dec, 2022 1 commit
- feat(server): Add model tests (#6) · a2985036
  OlivierDehaene authored Dec 08, 2022
  
  a2985036
01 Dec, 2022 1 commit
- feat(server): Support Galactica (#4) · daa1d81d
  OlivierDehaene authored Dec 01, 2022
  
  daa1d81d
04 Nov, 2022 1 commit
- feat(server): Support generic AutoModelForCausalLM · c5665f5c
  OlivierDehaene authored Nov 04, 2022
  
  c5665f5c
02 Nov, 2022 1 commit
- feat: Use json formatter by default in docker image · b3b7ea0d
  OlivierDehaene authored Nov 02, 2022
  
  b3b7ea0d
28 Oct, 2022 1 commit
- feat(server): Support all AutoModelForCausalLM on a best effort basis · 3cf6368c
  OlivierDehaene authored Oct 28, 2022
  
  3cf6368c
22 Oct, 2022 1 commit

feat(server): Use safetensors · c8ce9b25

Nicolas Patry authored Oct 22, 2022


Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com>

c8ce9b25

20 Oct, 2022 1 commit
- v0.1.0 · f16f2f5a
  Olivier Dehaene authored Oct 18, 2022
  
  f16f2f5a
17 Oct, 2022 1 commit
- feat: Improve error handling · 5e5d8766
  Olivier Dehaene authored Oct 17, 2022
  
  5e5d8766
08 Oct, 2022 1 commit
- Init · 295831a4
  Olivier Dehaene authored Oct 08, 2022
  
  295831a4