mudler/LocalAI

About

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

A small core, not a bundle. Each backend wraps a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...) in its own image, pulled only when a model needs it. You install nothing you don't use.

Created by Ettore Di Giacinto and maintained by the LocalAI team.

Note: The DMG is not signed by Apple. After installing, run: sudo xattr -d com.apple.quarantine /Applications/LocalAI.app. See #6268 for details.

Already ran LocalAI before? Use docker start -i local-ai to restart an existing container.

To test a running LocalAI server from the terminal,…

Excerpted from github.com/mudler/LocalAI