In theory, renegotiation should not really pose a problem.
We ran into this as well because the default
PIN policy on slot
9c deviates (per operation instead of per session).
While this
can be changed, not using the designated slots may restrict further hardware token use (e.g. blocking GPG slots).