Believe-it-or-not, the unmix levels feature works perfect for this, the problem with it is that processing is offline (so you cannot use it to audition audio in real-time).
I hope the next update of spectralayers directly does unmix levels in real-time.