Ollama

Get up and running with large language models locally.

Usage

Deployed on the solaria node for GPU acceleration.

API is available on port 11434.

Example check:

curl http://localhost:11434/api/tags