> For the complete documentation index, see [llms.txt](https://www.lumolabs.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.lumolabs.ai/using-the-model/how-to-inference.md).

# How to Inference

Lumo-8B-Instruct is currently published to the HuggingFace Hub, from where it can be downloaded/used by any user locally or on inferenced on a server. Lumo is not yet published as a chatbot for mass use, however it can be run locally.

The information on how to run it locally is shared below.

{% hint style="info" %}
**You can try out the Lumo-8B-Instruct live on** [**https://try-lumo8b.lumolabs.ai**](https://try-lumo8b.lumolabs.ai/)
{% endhint %}

<figure><img src="https://usercontent.one/wp/www.ralgar.one/wp-content/uploads/2024/07/ollama_hero-e1721322967117-1024x387.webp" alt=""><figcaption></figcaption></figure>

## STEP 1: Install Ollama

### Windows Installation

1. **Download**: Go to the [Ollama website](https://ollama.com/) and download the Windows installer (`OllamaSetup.exe`).
2. **Install**: Double-click the downloaded file and follow the installation prompts.
3. **Verify**: Open Command Prompt and run:

```
ollama --version
```

### macOS Installation

1. **Download**: Visit the [Ollama website](https://ollama.com/) and download the macOS installer.
2. **Install**: Open the downloaded file and follow the instructions.
3. **Verify**: Open Terminal and run:

```
ollama --version
```

### Linux Installation

1. **Open Terminal**.
2. **Run Command**:

   ```
   curl -fsSL https://ollama.com/install.sh | sh
   ```
3. **Verify**: Run:

   ```
   ollama --version
   ```

***

## STEP 2: Initiate the model on Ollama

Run the command on your terminal:

```
ollama run lumolabs/Lumo-8B-Instruct
```

or

```sh
ollama run hf.co/lumolabs-ai/Lumo-8B-Instruct
```

<figure><img src="/files/JQNeQqlLFvA9P3AK1jGt" alt=""><figcaption></figcaption></figure>

The first time you run the command, it may take some time depending on the network speed. It will only take time the first time you run the command.

***

## STEP 3: Start Conversing

Feel free to ask Lumo anything about the ecosystem, even code!

<figure><img src="/files/1EKi4zshYkiSRbg6sFTp" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/el4Ce7Ytn9kPTGyRMo0x" alt=""><figcaption></figcaption></figure>