Do you use Control room? When hunting for plugins that have latency, people tend to forget the control room. Some plugins that usually are put in the control room (like room/headphone correction software) can add latency, too, and they are always in the real time path.
That being said, if I record guitar through an Amp sim, I practically always use “Constrain delay compensation” to disable any plugin that has latency over my configured threshold. That’s what this function is designed for.
I have written a small howto regarding the different latencies and how to handle them some time ago, if it helps: