Openvpn configuration files and your PKI files can all be copied.
You will need to makes some changes to your config files, like your file paths.
Good luck with Windows Server, I wouldn't bother.
You can also use this to build inline files:
https://github.com/TinCanTech/easy-tls