Ollama

Inference & Routing

Run open models on your own machine with one command.

What it’s for

Ollama bundles model weights, a runtime and an OpenAI-compatible REST API behind a single CLI. It is the easiest way to develop against local models — no API keys, no rate limits, full privacy — which makes it a favorite for local development and testing.

How to use it

Install the app, run ollama pull llama3.1, then chat in the terminal or point any OpenAI-compatible client at http://localhost:11434/v1. Ideal for development, prototypes and air-gapped environments.

Pricing

Completely free and open source (MIT). You run it on your own hardware.

Website ↗ GitHub ↗