Does anyone have experience passing GPU to VM in Harvester?
I know that Harvester supports vGPU, but only few graphic card models support vGPU.
I have nVidia Quadro P5000 (Pascal) 16GB RAM and it doesn’t support vGPU.
I know, there are hacks and workaround. I tried few things, but was unable to figure out everything.
Here is my experience passing nVidia Quadro P5000:
Section 1 (not sure if needed):
- SSH to Harvester with GPU
sudo su
# make sure the card is present on the host:
lspci | grep -i nvidia
0000:d5:00.0 VGA compatible controller: NVIDIA Corporation GP104GL [Quadro P5000] (rev a1)
0000:d5:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
# prevent host from using GPU card:
# https://forums.unraid.net/topic/99478-solved-gpu-passthrough-issue-bar-0-cant-reserve/?do=findComment&comment=923145
echo 0 > /sys/class/vtconsole/vtcon0/bind
echo 0 > /sys/class/vtconsole/vtcon1/bind
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
Section 2
in Harvester web UI:
- Advanced → Addons → picdevices-controller → Enable
- wait while all PCI devices are listed
- enable passthrough for nvidia devices
- create VM. I used Ubuntu 22 cloud image with 4 cores and 12GB RAM, no GUI, server image
- add PCI devices. I only added “VGA compatible controller: NVIDIA Corporation GP104GL [Quadro P5000]”. I didin’t add “Audio device: NVIDIA Corporation GP104 High Definition Audio Controller”
- start the VM:
Section 3
SSH to VM and run:
# confirm the GPU is present in VM:
lspci | grep -i nvidia
0a:00.0 VGA compatible controller: NVIDIA Corporation GP104GL [Quadro P5000] (rev a1)
Download nVidia drivers by following instruction here:
# see the status:
nvidia-smi
I also installed CUDA toolkit from here:
Currently running OpenAI Whisper. Works great.
Next I want to install Docker on that Ubuntu host and run Frigate and Immich.
I would be curious to hear your experience with supported vGPU on Harvester. I’m currently considering getting system with nVidia RTX 5000.
Or may be someone figured out how to run vGPU even on non-supported cards?
Another question: since my P5000 doesn’t support vGPU, should I try to install Ubuntu on that server bare-metal, install regular nVidia drivers and join Harvester cluster as a worker node with GPU support? Or that will not work?