PrivateGPT

PrivateGPT is an open-source API layer, built by Zylon.ai, for turning locally-run language models into production-ready AI applications without depending on cloud APIs or rebuilding common backend primitives from scratch. It follows an API design modeled on the Claude API and provides a Messages API with streaming, async processing, and token counting; file and artifact ingestion for using documents as context; retrieval with citations for building source-grounded RAG experiences; structured access to databases, CSVs, and tabular data; and a built-in `/ui` workbench for testing, demos, and inspecting API requests. It works with any tool built for a local OpenAI-compatible provider, including coding assistants like Claude Code, OpenCode, VS Code, and Cline, and can power automation platforms like n8n. The project reports over 57,000 GitHub stars, more than 7,500 derived projects, and a 5,000+ member Discord community.