VST Connect SE

Just started to try using this feature and it seems a little quirky. My main problem is that when I try to record, the performer hears and sings in time with the music on his end but his performance is a second or more behind the music on my end and that’s how it gets recorded. We are both connected via ethernet cables directly into our routers so there is no wireless signals involved. When we talk to each other there is no latency, only when I hit Record is his performance way way behind the music only on my end. Thanks in advance for your help.