Llama.cpp

llama.cpp
Original author(s)Georgi Gerganov
Developer(s)Georgi Gerganov and community
Initial releaseMarch 10, 2023; 19 months ago (2023-03-10)[1]
Repositorygithub.com/ggerganov/llama.cpp
Written inC++, C
TypeLibrary for large language models
LicenseMIT License[2]

llama.cpp is an open source software library mostly written in C++ that performs inference on various Large Language Models such as Llama.[3] A CLI and web server is included with the library.[4] llama.cpp is co-developed alongside the GGML project, a general-purpose tensor library.[5]

  1. ^ Cite error: The named reference githubrelease was invoked but never defined (see the help page).
  2. ^ Cite error: The named reference license was invoked but never defined (see the help page).
  3. ^ Cite error: The named reference register-llamafile was invoked but never defined (see the help page).
  4. ^ Cite error: The named reference lwn was invoked but never defined (see the help page).
  5. ^ Cite error: The named reference ggml was invoked but never defined (see the help page).