Traffic wroteIntermittent HMAC failures .. sounds like there is some network corruption somewhere.
1. other traffic (not via the tunnel) goes through OK.
2. when the HMAC failures happen, they keep on happening. every packet is affected. nothing gets through the tunnel.
3. when i reboot both sides, the HMAC failures almost always go away.
4. the HMAC failures only start when OpenVPN is restarted on just ONE side.
5. the problem has been seen on several region-to-region pairs.
#4 suggested to me that the key changed. but the key files (referenced by --secret) were identical. i cannot see if the secret was mangled inside the process to see which end might be the culprit of a key corruption, if that was happening.
this is happening inside AWS cloud instances. i am working on trying to download logs and dumps to evaluate.