ollama

Running open models locally no longer needs the cloud — ollama compresses downloading, running, and serving into a few commands, offering a CLI, a REST API, and official Python / JS libraries across macOS, Windows, Linux, and Docker.