llama.cpp
Download llama.cpp 0.7.0, the free, MIT-licensed engine that runs open GGUF language models locally on CPU or GPU, with an OpenAI-compatible server. Install commands and first steps.
Open source
- Windows
- macOS
- Linux
Tag
gguf
1 program
Free games, apps and software, straight from official sources
Tag
1 program
Download llama.cpp 0.7.0, the free, MIT-licensed engine that runs open GGUF language models locally on CPU or GPU, with an OpenAI-compatible server. Install commands and first steps.
Open source