How do I configure the Windows OpenVPN client to only send NetBIOS/domain traffic over the VPN while sending all other traffic over the user's local internet connection?
first its not openvpns job to decide which traffic is sent where,
openvpn creates just another network adapter so its OS job to perform such a task.
if by saying "netbios traffic" you mean netbios broadcasts that you should use TAP and maybe bridge mode.
i would recommend using wins and AD dns services since AD does not rely on broadcasts but is uses
SRV dns records to discover where dns,kerb5 services are located.
Michael.