Open Source Alternative
Home / AI & LLM

LocalAI

Drop-in local replacement for the OpenAI API

LocalAI runs language, image, audio and embedding models on your own hardware and exposes an API that matches OpenAI's. It works without a GPU and supports several model backends.

inferenceopenai-compatibleself-hostedapi

More in AI & LLM

Featured

Ollama

AI & LLM

Run large language models on your own machine

vs OpenAI API, ChatGPTOpen sourcelocal-llminference

AnythingLLM

AI & LLM

All-in-one app for chatting with your documents

vs ChatGPT, Notion AIOpen sourceragdocuments

ComfyUI

AI & LLM

Node-based interface for image and video generation

vs Midjourney, DALL-EOpen sourceimage-generationdiffusion

GPT4All

AI & LLM

Local chat app for open language models

vs ChatGPTOpen sourcedesktoplocal-llm

Jan

AI & LLM

Offline ChatGPT-style desktop app

vs ChatGPTOpen sourcedesktoplocal-llm

Langfuse

AI & LLM

Tracing, evaluation and prompt management for LLM apps

vs LangSmith, HeliconeOpen sourceobservabilitytracing