Installed Components
- Ollama → a lightweight, extensible framework for running LLMs locally.
- Open WebUI → web interface for interacting with Ollama.
Installation Directory
The Docker Compose file for Open WebUI is located at:
/root/open-webui/docker-compose.yml
Working directory for the systemd service: /root/open-webui
Access Information
Web Interface:
- Open WebUI:
http://<server-ip>:8080 - It may take a few minutes for the UI to start.
- Access early to complete initial setup and create an admin user.
Ollama API:
- Base URL:
http://127.0.0.1:11434 - Accessible locally inside the server.
Ollama Usage
Run these commands directly in the terminal:
# Pull a model
ollama pull <model_name>
# Run a model
ollama run <model_name>
Example:
ollama pull llama3.1
ollama run llama3.1
Service Management
# Open WebUI
systemctl status open-webui
systemctl restart open-webui
# Ollama
systemctl status ollama
systemctl restart ollama
