Commits · b927244eb57d69fd92ecf36525f97e48f5b8b54f · OpenDAS / text-generation-inference

17 Apr, 2023 1 commit
- feat(python-client): get list of currently deployed tgi models using the inference API (#191) · b927244e
  OlivierDehaene authored Apr 17, 2023
  
  b927244e
11 Apr, 2023 2 commits
- feat(server): support OPT models (#55) · f26dfd0d
  OlivierDehaene authored Apr 11, 2023
```
OPT models do not all have a `tokenizer.json` file on the hub at the
moment. Can't merge for now.
```
  f26dfd0d
- feat(server): add flash attention llama (#144) · 299217c9
  OlivierDehaene authored Apr 11, 2023
  
  299217c9
04 Apr, 2023 1 commit
- docs(readme): provide link Logits Warper README (#154) · 9122e7bd
  Guspan Tanadi authored Apr 04, 2023
  
  9122e7bd
23 Mar, 2023 1 commit
- feat: Add note about NVIDIA drivers (#64) · 5e5e9d4b
  lewtun authored Mar 23, 2023
```
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
```
  5e5e9d4b
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
03 Mar, 2023 1 commit
- v0.3.2 (#97) · 1c19b093
  OlivierDehaene authored Mar 03, 2023
  
  1c19b093
14 Feb, 2023 1 commit
- feat: add safetensors conversion (#63) · 0fbc6919
  OlivierDehaene authored Feb 14, 2023
  
  0fbc6919
13 Feb, 2023 1 commit
- feat: add distributed tracing (#62) · 9af45414
  OlivierDehaene authored Feb 13, 2023
  
  9af45414
08 Feb, 2023 2 commits
- fixed SSE naming (#61) · e520d5b3
  Yannic Kilcher authored Feb 08, 2023
```
https://en.wikipedia.org/wiki/Server-sent_events
```
  e520d5b3
- fix(docker): increase shm size (#60) · 1ad3250b
  OlivierDehaene authored Feb 08, 2023
  
  1ad3250b
07 Feb, 2023 1 commit
- feat(server): support t5 (#59) · c503a639
  OlivierDehaene authored Feb 07, 2023
  
  c503a639
03 Feb, 2023 2 commits
- feat(docs): Clarify installation steps (#54) · a0dca443
  lewtun authored Feb 03, 2023
```
Adds some bits for first-time users (like me 😄 )
```
  a0dca443
- feat(router): refactor API and add openAPI schemas (#53) · 20c3c594
  OlivierDehaene authored Feb 03, 2023
  
  20c3c594
01 Feb, 2023 2 commits
- feat(server): support repetition penalty (#47) · 313194f6
  OlivierDehaene authored Feb 01, 2023
  
  313194f6
- feat(server): allow gpt-neox models with odd vocab sizes to be sharded (#48) · 2ad895a6
  OlivierDehaene authored Feb 01, 2023
  
  2ad895a6
31 Jan, 2023 1 commit
- feat(server): Support GPT-Neox (#39) · f830706b
  OlivierDehaene authored Jan 31, 2023
  
  f830706b
20 Jan, 2023 1 commit
- feat(server): Support SantaCoder (#26) · 15511edc
  OlivierDehaene authored Jan 20, 2023
  
  15511edc
15 Dec, 2022 1 commit
- feat: Return logprobs (#8) · 32a25306
  OlivierDehaene authored Dec 15, 2022
  
  32a25306
12 Dec, 2022 1 commit
- feat: Support stop sequences (#7) · 718096f6
  OlivierDehaene authored Dec 12, 2022
  
  718096f6
08 Dec, 2022 1 commit
- feat(server): Add model tests (#6) · a2985036
  OlivierDehaene authored Dec 08, 2022
  
  a2985036
01 Dec, 2022 1 commit
- feat(server): Support Galactica (#4) · daa1d81d
  OlivierDehaene authored Dec 01, 2022
  
  daa1d81d
14 Nov, 2022 1 commit
- fix(readme): Typo · feb7806c
  OlivierDehaene authored Nov 14, 2022
  
  feb7806c
07 Nov, 2022 1 commit
- feat(server): Improved doc · 4236e41b
  OlivierDehaene authored Nov 07, 2022
  
  4236e41b
04 Nov, 2022 2 commits
- feat(server): Support AutoModelForSeq2SeqLM · 427d7cc4
  OlivierDehaene authored Nov 04, 2022
  
  427d7cc4
- feat(server): Support generic AutoModelForCausalLM · c5665f5c
  OlivierDehaene authored Nov 04, 2022
  
  c5665f5c
03 Nov, 2022 1 commit
- fix(models): Revert buggy support for AutoModel · 755fc0e4
  OlivierDehaene authored Nov 03, 2022
  
  755fc0e4
02 Nov, 2022 1 commit
- feat: Use json formatter by default in docker image · b3b7ea0d
  OlivierDehaene authored Nov 02, 2022
  
  b3b7ea0d
28 Oct, 2022 1 commit
- feat(server): Support all AutoModelForCausalLM on a best effort basis · 3cf6368c
  OlivierDehaene authored Oct 28, 2022
  
  3cf6368c
27 Oct, 2022 1 commit
- feat(server): Support bitsandbytes · 09674e6d
  OlivierDehaene authored Oct 27, 2022
  
  09674e6d
22 Oct, 2022 1 commit

feat(server): Use safetensors · c8ce9b25

Nicolas Patry authored Oct 22, 2022


Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com>

c8ce9b25

20 Oct, 2022 1 commit
- v0.1.0 · f16f2f5a
  Olivier Dehaene authored Oct 18, 2022
  
  f16f2f5a
17 Oct, 2022 2 commits
- feat: Add arguments to CLI · 92c1ecd0
  Olivier Dehaene authored Oct 17, 2022
  
  92c1ecd0
- feat: Improve error handling · 5e5d8766
  Olivier Dehaene authored Oct 17, 2022
  
  5e5d8766
14 Oct, 2022 1 commit
- feat: Docker image · bf99afe9
  Olivier Dehaene authored Oct 14, 2022
  
  bf99afe9
11 Oct, 2022 1 commit
- Refactored gRPC interface · 4c693e65
  Olivier Dehaene authored Oct 11, 2022
```
Added validation logic
```
  4c693e65
08 Oct, 2022 1 commit
- Init · 295831a4
  Olivier Dehaene authored Oct 08, 2022
  
  295831a4