# Self-hosted Providers

## Ollama

To use Ollama you must set up an Ollama server first. You can download it from [here](https://ollama.com/). Once installed you need to download a model to use. A full list of all available models that support vision can be found [here](https://ollama.com/search?c=vision). Keep in mind that only models with vision capabilities can be used. LLM Vision works best with our own model, `glimpse-v1`.

```
ollama run llmvision/glimpse-v1
```

If your Home Assistant is **not** running on the same server as Ollama, you need to set the `OLLAMA_HOST` environment variable.

<details>

<summary>Linux</summary>

1. Edit the systemd service by calling `systemctl edit ollama.service`. This will open an editor.
2. For each environment variable, add a line Environment under section \[Service]:

```
[Service]
Environment="OLLAMA_HOST=0.0.0.0"
```

3. Save and close the editor.
4. Reload systemd and restart Ollama

```
systemctl daemon-reload
systemctl restart ollama
```

</details>

<details>

<summary>Windows</summary>

1. Quit Ollama from the system tray
2. Open File Explorer
3. Right click on This PC and select Properties
4. Click on Advanced system settings
5. Select Environment Variables
6. Under User variables click New
7. For variable name enter `OLLAMA_HOST` and for value enter `0.0.0.0`
8. Click OK and start Ollama again from the Start Menu

</details>

<details>

<summary>macOS</summary>

1. Open Terminal
2. Run the following command

```
launchctl setenv OLLAMA_HOST "0.0.0.0"
```

3. Restart Ollama

</details>

<details>

<summary><strong>Models</strong></summary>

See [Ollama model library](https://ollama.com/search?c=vision) for all models.

**Recommended Models**

**`gemma3`**

`qwen2.5vl`

</details>

## Open WebUI

Open WebUI is a self-hosted AI platform with a built-in inference engine for databases so you can add knowledge to your LLM which is also available in LLM Vision.

You will need to generate an API key in Settings > Account > JWT Token. In addition you also need to have at least one model (with vision support) added.

During setup you will need to provide:

* API key
* Model (`model_id`)
* IP address or hostname of your host
* Port (default is 3000)

## LocalAI

To use LocalAI you need to have a LocalAI server running. You can find the installation instructions [here](https://localai.io/basics/getting_started/). During setup you'll need to provide the IP address of your machine and port on which LocalAI is running (default is `8000`). If you want to use `HTTPS` to send requests you need to check the `HTTPS` box.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://llmvision.gitbook.io/getting-started/setup/providers/self-hosted-providers.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.