Created
March 27, 2025 01:28
-
-
Save tchayintr/311d3adc90c8fb4e753b4fd154f24a27 to your computer and use it in GitHub Desktop.
Fix Failed to initialize NVML: Unknown Error in ollama Docker container
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # https://github.com/ollama/ollama/issues/4604 | |
| # Add `"exec-opts": ["native.cgroupdriver=cgroupfs"]` to `/etc/docker/daemon.json` | |
| ``` | |
| { | |
| "default-runtime": "nvidia", | |
| "runtimes": { | |
| "nvidia": { | |
| "args": [], | |
| "path": "nvidia-container-runtime" | |
| } | |
| }, | |
| "exec-opts": ["native.cgroupdriver=cgroupfs"] | |
| } | |
| ``` | |
| # https://github.com/ollama/ollama/issues/6840 | |
| # Uncomment #no-cgroups = false in /etc/nvidia-container-runtime/config.toml | |
| sudo systemctl restart docker |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment