What are your desktop speakers connected to? Internal soundcard?
What ASIO driver are you switching to?..as built in sound probably has no ASIO driver?
If you have an interface why not connect the speakers to the interface and monitor everything through the interface?