Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
386c66f2
Unverified
Commit
386c66f2
authored
Aug 18, 2023
by
Michael Yang
Committed by
GitHub
Aug 18, 2023
Browse files
Merge pull request #378 from jmorganca/mxyng/copy-metadata-from-source
copy metadata from source
parents
3d79b414
5ca05c2e
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
36 additions
and
2 deletions
+36
-2
llm/llama.go
llm/llama.go
+15
-1
server/images.go
server/images.go
+21
-1
No files found.
llm/llama.go
View file @
386c66f2
...
@@ -117,7 +117,21 @@ func (llm *llamaModel) ModelFamily() ModelFamily {
...
@@ -117,7 +117,21 @@ func (llm *llamaModel) ModelFamily() ModelFamily {
}
}
func
(
llm
*
llamaModel
)
ModelType
()
ModelType
{
func
(
llm
*
llamaModel
)
ModelType
()
ModelType
{
return
ModelType30B
switch
llm
.
hyperparameters
.
NumLayer
{
case
26
:
return
ModelType3B
case
32
:
return
ModelType7B
case
40
:
return
ModelType13B
case
60
:
return
ModelType30B
case
80
:
return
ModelType65B
}
// TODO: find a better default
return
ModelType7B
}
}
func
(
llm
*
llamaModel
)
FileType
()
FileType
{
func
(
llm
*
llamaModel
)
FileType
()
FileType
{
...
...
server/images.go
View file @
386c66f2
...
@@ -325,7 +325,27 @@ func CreateModel(ctx context.Context, name string, path string, fn func(resp api
...
@@ -325,7 +325,27 @@ func CreateModel(ctx context.Context, name string, path string, fn func(resp api
}
}
if
mf
!=
nil
{
if
mf
!=
nil
{
log
.
Printf
(
"manifest = %#v"
,
mf
)
sourceBlobPath
,
err
:=
GetBlobsPath
(
mf
.
Config
.
Digest
)
if
err
!=
nil
{
return
err
}
sourceBlob
,
err
:=
os
.
Open
(
sourceBlobPath
)
if
err
!=
nil
{
return
err
}
defer
sourceBlob
.
Close
()
var
source
ConfigV2
if
err
:=
json
.
NewDecoder
(
sourceBlob
)
.
Decode
(
&
source
);
err
!=
nil
{
return
err
}
// copie the model metadata
config
.
ModelFamily
=
source
.
ModelFamily
config
.
ModelType
=
source
.
ModelType
config
.
FileType
=
source
.
FileType
for
_
,
l
:=
range
mf
.
Layers
{
for
_
,
l
:=
range
mf
.
Layers
{
newLayer
,
err
:=
GetLayerWithBufferFromLayer
(
l
)
newLayer
,
err
:=
GetLayerWithBufferFromLayer
(
l
)
if
err
!=
nil
{
if
err
!=
nil
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment