I actually haven't ever set this up myself yet, but you can take a look at push "redirect-gateway def1" in the howto page
http://openvpn.net/index.php/open-source/documentation/howto.html
If you can't get it to work right off the bat by next week, what I would do is just remote desktop back to my home workstation and use the browser on the remote session and it essentially does the same thing. I connect my remote desktop session through my vpn so it is secure. I have firewalled my remote desktop so that only my vpn subnet can access it and I only have to port forward one port (my vpn port). Depending on your connection it may be slow sometimes, but it makes me feel good to know that someone can't easily snoop on me. It also provides the ability to visits some sites that the hotel may block which is a bonus. If I am not doing anything serious (e.g., googling or wikipedia) they can snoop all they want - it isn't usually worth the hassle tunneling everything through a vpn.
One potential gotcha is if they really restrict the ports that you can use (e.g., http/https). If you are not also running a webserver on 80 and 443 you can always port forward them to your openvpn server so that you can circumvent even the most restrictive situations. In reality, I have only come across these situations at major universities rather than hotels and coffee shops. I typically have to utilize a proxy server to circumvent these scenarios. I also would change your openvpn subnet and the subnet on your home lan to something other than the default (e.g., 192.168.1.0/24) because I have run into issues with that.