Original author(s) | Georgi Gerganov |
---|---|
Developer(s) | Georgi Gerganov and community |
Initial release | March 10, 2023[1] |
Repository | github |
Written in | C++, C |
Type | Library for large language models |
License | MIT License[2] |
llama.cpp is an open source software library mostly written in C++ that performs inference on various Large Language Models such as Llama.[3] A CLI and web server is included with the library.[4] llama.cpp is co-developed alongside the GGML project, a general-purpose tensor library.[5]
githubrelease
was invoked but never defined (see the help page).license
was invoked but never defined (see the help page).register-llamafile
was invoked but never defined (see the help page).lwn
was invoked but never defined (see the help page).ggml
was invoked but never defined (see the help page).