> For the complete documentation index, see [llms.txt](https://www.lumolabs.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.lumolabs.ai/using-the-model/how-to-inference.md).

# How to Inference

Lumo-8B-Instruct is currently published to the HuggingFace Hub, from where it can be downloaded/used by any user locally or on inferenced on a server. Lumo is not yet published as a chatbot for mass use, however it can be run locally.

The information on how to run it locally is shared below.

{% hint style="info" %}
**You can try out the Lumo-8B-Instruct live on** [**https://try-lumo8b.lumolabs.ai**](https://try-lumo8b.lumolabs.ai/)
{% endhint %}

<figure><img src="https://usercontent.one/wp/www.ralgar.one/wp-content/uploads/2024/07/ollama_hero-e1721322967117-1024x387.webp" alt=""><figcaption></figcaption></figure>

## STEP 1: Install Ollama

### Windows Installation

1. **Download**: Go to the [Ollama website](https://ollama.com/) and download the Windows installer (`OllamaSetup.exe`).
2. **Install**: Double-click the downloaded file and follow the installation prompts.
3. **Verify**: Open Command Prompt and run:

```
ollama --version
```

### macOS Installation

1. **Download**: Visit the [Ollama website](https://ollama.com/) and download the macOS installer.
2. **Install**: Open the downloaded file and follow the instructions.
3. **Verify**: Open Terminal and run:

```
ollama --version
```

### Linux Installation

1. **Open Terminal**.
2. **Run Command**:

   ```
   curl -fsSL https://ollama.com/install.sh | sh
   ```
3. **Verify**: Run:

   ```
   ollama --version
   ```

***

## STEP 2: Initiate the model on Ollama

Run the command on your terminal:

```
ollama run lumolabs/Lumo-8B-Instruct
```

or

```sh
ollama run hf.co/lumolabs-ai/Lumo-8B-Instruct
```

<figure><img src="https://3886194858-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaIMUIIIWTZWKkkBAT0Fc%2Fuploads%2FGKyZVZgRukcC7ekphGKI%2FScreenshot%202025-01-15%20at%2010.16.53%E2%80%AFPM.png?alt=media&amp;token=37d38ccd-f7ef-49a1-98ec-ba8afa75df96" alt=""><figcaption></figcaption></figure>

The first time you run the command, it may take some time depending on the network speed. It will only take time the first time you run the command.

***

## STEP 3: Start Conversing

Feel free to ask Lumo anything about the ecosystem, even code!

<figure><img src="https://3886194858-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaIMUIIIWTZWKkkBAT0Fc%2Fuploads%2FWi9QFMLsJL8j6PDvNrCn%2FScreenshot%202025-01-15%20at%2010.21.15%E2%80%AFPM.png?alt=media&amp;token=d60c522f-3ea9-48e1-a68c-ac6e4626d1d0" alt=""><figcaption></figcaption></figure>

<figure><img src="https://3886194858-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FaIMUIIIWTZWKkkBAT0Fc%2Fuploads%2FHTacyqze1EW7hwKtJZxh%2FScreenshot%202025-01-15%20at%2010.20.59%E2%80%AFPM.png?alt=media&amp;token=85c2d86a-da77-4916-923d-369ff0ae26cf" alt=""><figcaption></figcaption></figure>
