Hosting Ollama Starts With Environment Variables
AI Summary
Summary: Olama AI Server Configuration
- Purpose of Olama:
- Designed as a cornerstone for AI applications.
- Simplifies running AI models on local machines.
- Usable by non-experts through a text UI or other tools.
- Configuration Needs:
- Adjustments may be required for server settings (e.g., IP address, web origins).
- Disable server pruning for slow networks or set a proxy.
- Setting Environment Variables:
- Common issue: Incorrectly setting environment variables.
- Variables must be set for the AMA server, not the default shell.
- Linux Systems:
- Use
systemctl edit .service
to set environment variables.- Example:
AMA_HOST=0.0.0.0
.- Mac Systems:
- Previous method: Stop server, set variable in terminal, keep terminal running.
- New method: Use
launchctl setenv
and restart the server.- Benefits: Seamless updates, logs in AMA logs, no need for open terminal.
- Conclusion:
- The updated process is more convenient.