Yes, you can generate certs on Debian/Linux and use them on Windows.
Did you read the HOWTO? modify the 'vars' file (on linux) , then run
. ./vars
./clean-all
./build-key client
the second command will clear out all existing keys but it will also set up a new index.txt and serial file.