Cubase 11 and 12 ASIO LOAD spikes /w external FX

So big problem here and I have no idea why. I switched to Big Sur 11.6.4 and I’m getting huge asio load spikes on my rme fireface 802, connected both on firewire and on usb. This never happened in Cataline with Cubase 11 (2 weeks ago). Is there something I need to mess with on Big Sur? Does anyone else have this issue?