LLaMA.cpp

[edit]

• Overview
• Details
• About this entry

LLaMA.cpp

https://github.com/ggerganov/llama.cpp
Inference of LLaMA model in pure C/C++

Port of Meta's LLaMA model in C/C++ to run on CPU instead of GPU.

Download

https://github.com/ggerganov/llama.cpp/archive/refs/tags/b1266.tar.gz

VCS Checkout

git clone https://github.com/ggerganov/llama.cpp

Categories

• Programming-language:python
• Programming-language:C
• Programming-language:C++
• Programming-language:javascript
• Programming-language:shell
• Runs-on:GNU/Linux
• Runs-on:Windows
• Runs-on:BSD
• Runs-on:OS X
• Science:artificial-intelligence

Licensing

License

Verified by

Verified on

Notes

License

Expat

Verified by

GNUtoo, craigt

Verified on

22 September 2023

Notes

https://raw.githubusercontent.com/ggerganov/llama.cpp/master/LICENSE

Leaders and contributors

Resources and communication

Software prerequisites

Kind	Description
Required to use	sentencepiece
Required to use	python
Required to use	PyTorch
Required to use	numpy

Entry

Property "Submitted by" (as page type) with input value "{{{Submitted by}}}" contains invalid characters or is incomplete and therefore can cause unexpected results during a query or annotation process. "{{{Submitted date}}}" contains an extrinsic dash or other characters that are invalid for a date interpretation.