Running Autoruns to remove some other programs, I found entries related to OpenVPN that seem garbage left in the registry I suppose by the installer

that point to the registry here

This is not something that will disappear on reboot since I have done it several times.