Sometimes when loading or unloading a vst, there's a red cpu spike and my analyzer shows audio

Hello, it’s super weird, very often when I disable a vst or load one, or even change a kontakt patch, I’d get a red spike in the cpu meter and even more weird, sometimes the analyzer on my master shows audio on the spectrum but I am playing no audio when disabling vst