Direct monitoring lack of knowledge

Hi there,
I have MIC to PREAMP to BABYFACE RME to CUBASE 9 in PC. I was having problems with weird sounds in my voice when recording. I have solved the problem of the sounds, but now I have the problem of having to much latency. My buffer size was at 256 and I increased it to 1024. I’ve been reading a bit, but still a bit confused. If I set direct monitoring, will I stop from hearing that annoying latency? How do I set my direct monitoring feature ? Do I set it up in more than one place inside Cubase? Do I have to set it up also in my Babyface RME. Please help me.

Jose L. Guinea