Llama (language model)

Not to be confused with LaMDA.
Llama
Developer(s)Meta AI
Initial releaseFebruary 24, 2023; 19 months ago (2023-02-24)
Stable release
Llama 3.2 / September 25, 2024; 25 days ago (2024-09-25)
Repositorygithub.com/meta-llama/llama-models
Written inPython
Type
LicenseMeta Llama 3.2 Community License[1]
Websitewww.llama.com

Llama (Large Language Model Meta AI, formerly stylized as LLaMA) is a family of autoregressive large language models (LLMs) released by Meta AI starting in February 2023.[2][3] The latest version is Llama 3.2, released in September 2024.[4]

Model weights for the first version of Llama were made available to the research community under a non-commercial license, and access was granted on a case-by-case basis.[5][3] Unauthorized copies of the model were shared via BitTorrent. In response, Meta AI issued DMCA takedown requests against repositories sharing the link on GitHub.[6][7] Subsequent versions of Llama were made accessible outside academia and released under licenses that permitted some commercial use.[8][9] Llama models are trained at different parameter sizes, ranging between 1B and 405B.[10] Originally, Llama was only available as a foundation model.[11] Starting with Llama 2, Meta AI started releasing instruction fine-tuned versions alongside foundation models.[9]

Alongside the release of Llama 3, Meta added virtual assistant features to Facebook and WhatsApp in select regions, and a standalone website. Both services use a Llama 3 model.[12]

  1. ^ "llama-models/models/llama3_2/LICENSE at main · meta-llama/llama-models · GitHub". GitHub. Archived from the original on 2024-09-29. Retrieved 2024-10-20.
  2. ^ Cite error: The named reference l1arxiv was invoked but never defined (see the help page).
  3. ^ a b Cite error: The named reference blog was invoked but never defined (see the help page).
  4. ^ Knight, Will. "Meta Releases Llama 3.2—and Gives Its AI a Voice". Wired. ISSN 1059-1028. Retrieved 2024-09-25.
  5. ^ Malik, Yuvraj; Paul, Katie (25 February 2023). "Meta heats up Big Tech's AI arms race with new language model". Reuters.
  6. ^ Cite error: The named reference verge-leak was invoked but never defined (see the help page).
  7. ^ Cite error: The named reference githubdcma was invoked but never defined (see the help page).
  8. ^ David, Emilia (30 October 2023). "Meta's AI research head wants open source licensing to change". The Verge. Archived from the original on 14 September 2024. Retrieved 20 October 2024.
  9. ^ a b Cite error: The named reference llama2blog was invoked but never defined (see the help page).
  10. ^ "Introducing Llama 3.1: Our most capable models to date". ai.meta.com. July 23, 2024. Archived from the original on 2024-07-23. Retrieved 2024-07-23.
  11. ^ Peters, Jay; Vincent, James (24 February 2023). "Meta has a new machine learning language model to remind you it does AI too". The Verge.
  12. ^ "Meet Your New Assistant: Meta AI, Built With Llama 3". Meta. 18 April 2024. Archived from the original on 7 October 2024. Retrieved 20 October 2024.