Developer Tools Tools

LPU inference engine delivering the fastest AI model response times.

Ollama

Ollama

Tool for running large language models locally on your own machine.

Open-source ChatGPT alternative running 100% offline on your computer.

MLOps platform for experiment tracking, model versioning and monitoring.

PrivateGPT

Privategpt

Privately interact with documents using local AI — 100% offline.

Portkey AI

Portkey

AI gateway with load balancing, fallbacks and full observability.

AnythingLLM

Anythingllm

All-in-one AI application for chatting with documents locally or in cloud.

LiteLLM

Litellm

Open-source proxy server unifying 100+ LLM APIs into one interface.

Replicate

Replicate

Run open-source ML models in the cloud with a simple REST API.

Open-source LLM observability platform for tracing and prompt management.

TypeScript toolkit for building streaming AI-powered web applications.

AI observability and monitoring platform with caching for LLM apps.

Central hub for sharing, discovering and deploying open ML models and datasets.

OpenAI API

Openai

Access GPT-4o, DALL-E 3, Whisper, TTS and Embeddings via REST API.

Together AI

Together

Fast inference API for 100+ open-source LLMs at competitive prices.

Enterprise AI platform for semantic search and text generation at scale.