localai/localai
LocalAI is the free, Open Source OpenAI alternative
5M+
localai/localai repository overview
:bulb: Get help - ❓FAQ 💭Discussions :speech_balloon: Discord :book: Documentation website
💻 Quickstart 🖼️ Models 🚀 Roadmap 🥽 Demo 🌍 Explorer 🛫 Examples
LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by Ettore Di Giacinto.
📚🆕 Local Stack Family
🆕 LocalAI is now part of a comprehensive suite of AI tools designed to work together:
|
LocalAGIA powerful Local AI agent management platform that serves as a drop-in replacement for OpenAI's Responses API, enhanced with advanced agentic capabilities. |
|
LocalRecallA REST-ful API and knowledge base management system that provides persistent memory and storage capabilities for AI agents. |
Screenshots
| Talk Interface | Generate Audio |
|---|---|
 | |
| Models Overview | Generate Images |
|---|---|
 |  |
| Chat Interface | Home |
|---|---|
 |  |
| Login | Swarm |
|---|---|
 |  |
💻 Quickstart
Run the installer script:
curl https://localai.io/install.sh | sh
Or run with docker:
CPU only image:
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-cpu
Nvidia GPU:
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12
CPU and GPU image (bigger size):
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
AIO images (it will pre-download a set of models ready for use, see https://localai.io/basics/container/)
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu
To load models:
# From the model gallery (see available models with `local-ai models list`, in the WebUI from the model tab, or visiting https://models.localai.io)
local-ai run llama-3.2-1b-instruct:q4_k_m
# Start LocalAI with the phi-2 model directly from huggingface
local-ai run huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
# Install and run a model from the Ollama OCI registry
local-ai run ollama://gemma:2b
# Run a model from a configuration file
local-ai run https://gist.githubusercontent.com/.../phi-2.yaml
# Install and run a model from a standard OCI registry (e.g., Docker Hub)
local-ai run oci://localai/phi-2:latest
For more information, see 💻 Getting started
Tag summary
Content type
Image
Digest
sha256:9f638b36b…
Size
4 GB
Last updated
about 3 hours ago
docker pull localai/localai:sha-2bed6f6-gpu-hipblasThis week's pulls
Pulls:
168,298
Jun 29 to Jul 5