Ollama

Namespace ai
Kuztomization deployment
HTTPRoute https://ollama.leechpepin.com:11434
Public False
Auth N/A
Requirement 1 GPU
Tolerations GPU

Note: This currently has to be deployed on dresden to be able to leverage the GPU.

Links