Hi @aelfric3,
You could try this workaround changing the Spitfire Audio Player settings for BBC SO.
I had e similar problem like you. The guys at Spitfire Audio gave me this temp solution.
It works for me, but still it’s a temp.
I tried to “force” them to improve the performance of their plugin, but they said that I’m the only
one to complain, but obviously I’m not. So, I recommend you to inform them about your issue.
I hope this will improve your situation! 
Best wishes,
Thurisaz