How to Inference
Last updated
Last updated
Lumo-8B-Instruct is currently published to the HuggingFace Hub, from where it can be downloaded/used by any user locally or on inferenced on a server. Lumo is not yet published as a chatbot for mass use, however it can be run locally.
The information on how to run it locally is shared below.
You can try out the Lumo-8B-Instruct live on https://try-lumo8b.lumolabs.ai
Download: Go to the Ollama website and download the Windows installer (OllamaSetup.exe
).
Install: Double-click the downloaded file and follow the installation prompts.
Verify: Open Command Prompt and run:
Download: Visit the Ollama website and download the macOS installer.
Install: Open the downloaded file and follow the instructions.
Verify: Open Terminal and run:
Open Terminal.
Run Command:
Verify: Run:
Run the command on your terminal:
or
The first time you run the command, it may take some time depending on the network speed. It will only take time the first time you run the command.
Feel free to ask Lumo anything about the ecosystem, even code!