Joseph22 wrote
OpenVPN-Server has the IP 192.168.178.10/24
..
Now I cannot connect to OpenVPN or RDP using the FritzBox public IP when I am in my home LAN (which has 192.168.178.67).
So your server is in your home on the same LAN as your client.
This means your FritzBox does not support
hairpinning