How to Inference

Lumo-8B-Instruct is currently published to the HuggingFace Hub, from where it can be downloaded/used by any user locally or on inferenced on a server. Lumo is not yet published as a chatbot for mass use, however it can be run locally.

The information on how to run it locally is shared below.

STEP 1: Install Ollama

Windows Installation

1. Download: Go to the Ollama website and download the Windows installer (OllamaSetup.exe).

2. Install: Double-click the downloaded file and follow the installation prompts.

3. Verify: Open Command Prompt and run:

ollama --version

macOS Installation

1. Download: Visit the Ollama website and download the macOS installer.

2. Install: Open the downloaded file and follow the instructions.

3. Verify: Open Terminal and run:

ollama --version

Linux Installation

1. Open Terminal.

2. Run Command:

   Copy

   curl -fsSL https://ollama.com/install.sh | sh

3. Verify: Run:

   Copy

   ollama --version

STEP 2: Initiate the model on Ollama

Run the command on your terminal:

ollama run lumolabs/Lumo-8B-Instruct

or

ollama run hf.co/lumolabs-ai/Lumo-8B-Instruct

The first time you run the command, it may take some time depending on the network speed. It will only take time the first time you run the command.

STEP 3: Start Conversing

Feel free to ask Lumo anything about the ecosystem, even code!