Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
Commits
98330df6
Unverified
Commit
98330df6
authored
Oct 28, 2024
by
Nicolas Patry
Committed by
GitHub
Oct 28, 2024
Browse files
Monkey patching as a desperate measure. (#2704)
* Monkey patching as a desperate measure. * New snapshot ?
parent
513d19b9
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
23 additions
and
11 deletions
+23
-11
integration-tests/conftest.py
integration-tests/conftest.py
+12
-0
integration-tests/models/__snapshots__/test_flash_starcoder_gptq/test_flash_starcoder_gptq_default_params.json
...rcoder_gptq/test_flash_starcoder_gptq_default_params.json
+11
-11
No files found.
integration-tests/conftest.py
View file @
98330df6
# ruff: noqa: E402
import
requests
class
SessionTimeoutFix
(
requests
.
Session
):
def
request
(
self
,
*
args
,
**
kwargs
):
timeout
=
kwargs
.
pop
(
"timeout"
,
120
)
return
super
().
request
(
*
args
,
**
kwargs
,
timeout
=
timeout
)
requests
.
sessions
.
Session
=
SessionTimeoutFix
import
asyncio
import
contextlib
import
json
...
...
integration-tests/models/__snapshots__/test_flash_starcoder_gptq/test_flash_starcoder_gptq_default_params.json
View file @
98330df6
...
...
@@ -16,52 +16,52 @@
},
{
"id"
:
21017
,
"logprob"
:
-9.09375
,
"logprob"
:
-9.0
85
9375
,
"text"
:
"ometric"
},
{
"id"
:
81
,
"logprob"
:
-0.259
0332
,
"logprob"
:
-0.259
27734
,
"text"
:
"_"
},
{
"id"
:
6009
,
"logprob"
:
-2.2
0312
5
,
"logprob"
:
-2.2
10937
5
,
"text"
:
"mean"
},
{
"id"
:
26
,
"logprob"
:
-0.
30029297
,
"logprob"
:
-0.
2993164
,
"text"
:
"("
},
{
"id"
:
62
,
"logprob"
:
-5.67
57812
,
"logprob"
:
-5.67
1875
,
"text"
:
"L"
},
{
"id"
:
44
,
"logprob"
:
-3.0
89843
8
,
"logprob"
:
-3.0
74218
8
,
"text"
:
":"
},
{
"id"
:
1682
,
"logprob"
:
-0.67
33398
4
,
"logprob"
:
-0.67
7734
4
,
"text"
:
" List"
},
{
"id"
:
77
,
"logprob"
:
-0.38
69629
,
"logprob"
:
-0.38
354492
,
"text"
:
"["
},
{
"id"
:
1808
,
"logprob"
:
-0.9
2041016
,
"logprob"
:
-0.9
1845703
,
"text"
:
"float"
},
{
"id"
:
10794
,
"logprob"
:
-2.53
90625
,
"logprob"
:
-2.53
71094
,
"text"
:
"]):"
}
],
...
...
@@ -69,7 +69,7 @@
"tokens"
:
[
{
"id"
:
284
,
"logprob"
:
0.0
,
"logprob"
:
-
0.0
48583984
,
"special"
:
false
,
"text"
:
"
\n
"
},
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment