Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
orangecat
ollama
Commits
527cc978
Unverified
Commit
527cc978
authored
Dec 10, 2024
by
Jeffrey Morgan
Committed by
GitHub
Dec 10, 2024
Browse files
llama: update vendored code to commit 40c6d79f (#7875)
parent
a37f4a86
Changes
288
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
22 additions
and
22 deletions
+22
-22
llama/ggml-cuda/sum.cu
llama/ggml-cuda/sum.cu
+3
-3
llama/ggml-cuda/sum.cuh
llama/ggml-cuda/sum.cuh
+1
-1
llama/ggml-cuda/sumrows.cu
llama/ggml-cuda/sumrows.cu
+1
-1
llama/ggml-cuda/sumrows.cuh
llama/ggml-cuda/sumrows.cuh
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-f16.cu
...emplate-instances/fattn-vec-f16-instance-hs128-f16-f16.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q4_0.cu
...mplate-instances/fattn-vec-f16-instance-hs128-f16-q4_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q4_1.cu
...mplate-instances/fattn-vec-f16-instance-hs128-f16-q4_1.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q5_0.cu
...mplate-instances/fattn-vec-f16-instance-hs128-f16-q5_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q5_1.cu
...mplate-instances/fattn-vec-f16-instance-hs128-f16-q5_1.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q8_0.cu
...mplate-instances/fattn-vec-f16-instance-hs128-f16-q8_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-f16.cu
...mplate-instances/fattn-vec-f16-instance-hs128-q4_0-f16.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q4_0.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_0-q4_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q4_1.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_0-q4_1.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q5_0.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_0-q5_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q5_1.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_0-q5_1.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q8_0.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_0-q8_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-f16.cu
...mplate-instances/fattn-vec-f16-instance-hs128-q4_1-f16.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q4_0.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_1-q4_0.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q4_1.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_1-q4_1.cu
+1
-1
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q5_0.cu
...plate-instances/fattn-vec-f16-instance-hs128-q4_1-q5_0.cu
+1
-1
No files found.
llama/ggml-cuda/sum.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
@@ -24,9 +24,9 @@
* SOFTWARE.
*/
#if !defined(GGML_USE_HIP
BLAS
) && !defined(GGML_USE_MUSA) && CUDART_VERSION >= 11700
#if !defined(GGML_USE_HIP) && !defined(GGML_USE_MUSA) && CUDART_VERSION >= 11700
#define USE_CUB
#endif // !defined(GGML_USE_HIP
BLAS
) && !defined(GGML_USE_MUSA) && CUDART_VERSION >= 11700
#endif // !defined(GGML_USE_HIP) && !defined(GGML_USE_MUSA) && CUDART_VERSION >= 11700
#ifdef USE_CUB
// On Windows CUB uses libraries with variables called CC_PASCAL which conflict with the define in common.cuh.
...
...
llama/ggml-cuda/sum.cuh
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/sumrows.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/sumrows.cuh
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-f16.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q4_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q4_1.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q5_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q5_1.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-f16-q8_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-f16.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q4_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q4_1.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q5_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q5_1.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_0-q8_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-f16.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q4_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q4_1.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
llama/ggml-cuda/template-instances/fattn-vec-f16-instance-hs128-q4_1-q5_0.cu
View file @
527cc978
/**
* llama.cpp - commit
3f1ae2e32cde00c39b96be6d01c2997c29bae555
- do not edit this file
* llama.cpp - commit
40c6d79fb52f995f47507fedfeaae2ac05d9b35c
- do not edit this file
*
* MIT License
*
...
...
Prev
1
2
3
4
5
6
7
8
9
10
…
15
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment