Open Source Alternative

Ollama

Run large language models on your own machine

Ollama downloads and runs open models such as Llama, Mistral and Gemma locally with one command. It exposes a local API that many apps can use in place of a hosted model service.

local-llminferencemodelscli

More in AI & LLM

AnythingLLM

AI & LLM

All-in-one app for chatting with your documents

vs ChatGPT, Notion AIOpen sourceragdocuments

ComfyUI

AI & LLM

Node-based interface for image and video generation

vs Midjourney, DALL-EOpen sourceimage-generationdiffusion

GPT4All

AI & LLM

Local chat app for open language models

vs ChatGPTOpen sourcedesktoplocal-llm

Jan

AI & LLM

Offline ChatGPT-style desktop app

vs ChatGPTOpen sourcedesktoplocal-llm

Langfuse

AI & LLM

Tracing, evaluation and prompt management for LLM apps

vs LangSmith, HeliconeOpen sourceobservabilitytracing

LibreChat

AI & LLM

ChatGPT-style interface for many model providers

vs ChatGPT, Claude.aiOpen sourcechat-uimulti-model