"Reverse" Latency when recording audio in Cubase

Hey, I’m using a Scarlet 2i2 as the interface and facing the same problem. How can I prevent this “reverse delay”? My buffer time is set to 4ms and it shifts quite a lot to the left of the cursor.