When I try to come via the adsl/router (which is set up to do port forwarding to this machine) it doesn't connect when the vpn is connected
this is normal because your ssh responses return via the vpn not via your direct internet line,
do avoid this you will need to configure policy based routing on your server,
search the forum since there are many similar topics...
Michael.