Hello,
I did some tests myself and noticed that latency is high while using IPsec tunnel, but it is expected behavior because IPsec does use encryption and that takes some time. If current latency is not an option for you, you could select simpler encryption, authentication protocols to decrease at least part of the latency.
Regards.