Callya
I found it out and could solve the issue:
On the clients were a route missing: 192.168.254.0/24 via 192.168.2.4 dev eth0
So the ICMP echo was sent to the correct destination, but the reply was sent over the default gateway what does not have the route back and so the ping failed.