When I use samples or vst I put them on time but the click tempo is more advanced, ocea the samples and vst they are delayed PDT: It is not the latency.
What could it be? 
Probably the click. But with that really well and detailed description - could be anything.