Skip to content

Free games, apps and software, straight from official sources

RSS

Tag

local llm

6 programs

Software

KoboldCpp

Download KoboldCpp, the free single-file app that runs GGUF models locally with a web UI, image generation, speech and an OpenAI-compatible API.

Open source

  • Windows
  • Linux
  • macOS

TextGen (text-generation-webui)

Download TextGen, formerly text-generation-webui by oobabooga: a free desktop app and web UI for running local LLMs, with portable builds and an API.

Open source

  • Windows
  • Linux
  • macOS
Version 4.9

llamafile

Download llamafile from Mozilla.ai: a single executable file that runs open language models locally with nothing to install. Quick start and tips.

Open source

  • Windows
  • macOS
  • Linux
Version 0.10.6

Jan

Download Jan, the free, open-source desktop app that runs AI models like Llama, Gemma and Qwen offline on Windows, macOS and Linux.

Open source

  • Windows
  • macOS
  • Linux

llama.cpp

Download llama.cpp 0.7.0, the free, MIT-licensed engine that runs open GGUF language models locally on CPU or GPU, with an OpenAI-compatible server. Install commands and first steps.

Open source

  • Windows
  • macOS
  • Linux
Version 0.7.0

Ollama

Download Ollama 0.40.12, the free, open-source tool that runs open language models like Gemma, Qwen and DeepSeek on your own computer with one command. Install, first steps, hardware.

Open source

  • Windows
  • macOS
  • Linux
Version 0.40.12